-- Logs begin at Mon 2022-07-11 13:52:58 UTC, end at Mon 2022-07-11 14:54:53 UTC. -- Jul 11 14:24:55.672288 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 14:24:55.679568 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:24:55 2022] *** Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: nodename: dv-osbrick-master-4-iscsi Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: machine: x86_64 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: clock source: unix Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: pcre jit disabled Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: detected number of CPU cores: 4 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: current working directory: / Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: your processes number limit is 47680 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: your memory page size is 4096 bytes Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: detected max file descriptor number: 2048 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: lock engine: pthread robust mutexes Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: thunder lock: enabled Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 14:24:55.684253 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:24:55.726490 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: Python main interpreter initialized at 0x560676bc89c0 Jul 11 14:24:55.726490 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: python threads support enabled Jul 11 14:24:55.726490 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: your server socket listen backlog is limited to 100 connections Jul 11 14:24:55.726490 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:24:55.727052 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:24:55.727052 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: *** Operational MODE: preforking *** Jul 11 14:24:55.727223 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:24:55.727223 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: spawned uWSGI master process (pid: 80372) Jul 11 14:24:55.727387 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 11 14:24:55.729449 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: spawned uWSGI worker 1 (pid: 80384, cores: 1) Jul 11 14:24:55.729449 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: spawned uWSGI worker 2 (pid: 80385, cores: 1) Jul 11 14:24:55.729449 dv-osbrick-master-4-iscsi devstack@keystone.service[80372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:25:01.163946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:01.163946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: from cryptography.utils import int_from_bytes Jul 11 14:25:01.164747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:01.164747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes Jul 11 14:25:01.165207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:01.165207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: from cryptography.utils import int_from_bytes Jul 11 14:25:01.165310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:25:01.165310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: from cryptography.utils import int_from_bytes Jul 11 14:25:01.214215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:25:01.214415 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:25:01.214614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:25:01.214719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] command line args: [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:25:01.214826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:25:01.214951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:25:01.215040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] command line args: [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:25:01.215160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ================================================================================ {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:25:01.215282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:25:01.215462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ================================================================================ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:25:01.215540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] admin_token = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.215717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.215804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] config_dir = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.215965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_dir = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] config_source = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] config_source = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] debug = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] debug = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.216835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.217932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_config_append = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_config_append = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_dir = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_dir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_file = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.218963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219508 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219844 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.219923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.220970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221706 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.221938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] publish_errors = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] publish_errors = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222859 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.222970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223378 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] standard_threads = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.223919 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] standard_threads = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_journal = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] use_journal = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_json = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.224973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] use_json = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] use_stderr = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_stderr = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] use_syslog = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] use_syslog = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:25:01.225657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.225740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.225894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.225972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.226898 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.227971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.228148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.228226 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.228384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.228498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229765 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.229935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230414 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.230986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.231832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.232977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.233940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234665 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234911 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.234990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235458 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.235998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.236822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.237944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238005 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238071 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238731 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.238967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239120 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239593 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239694 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.239907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.240883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.241993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242463 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.242991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243151 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.243950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.244986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245429 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.245895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.246781 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247004 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247807 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.247955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.248987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.249932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250889 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.250976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.external = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.251959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.external = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.password = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252570 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] auth.token = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.252904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.password = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] auth.token = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253787 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.253866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.254971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.255999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.256929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257768 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.257929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258731 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.258974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.259959 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260193 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.260961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261232 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261859 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.261963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.262902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263790 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.263866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264564 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264734 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.264975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.265971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.266991 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.267944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.268918 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.269892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270036 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.270974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271457 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.271923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.272940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273263 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.273947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274414 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.274921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.275078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.275155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.275847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.275930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.276936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.277979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.278940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.279876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280612 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.280965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281443 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.281914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.282997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.283939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284699 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.284980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285232 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.285934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286572 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] role.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.286944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] role.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287820 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.287957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288340 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.288993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.289989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.290871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.291112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.291279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.291914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292221 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292366 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.292964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.293973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.294902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.295952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296109 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296564 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.296886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.297946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298240 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.298848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299153 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.299968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.300842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301670 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.301895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.connection = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.302947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.303979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.304977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305464 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305575 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305699 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305814 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.305931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:25:01.306049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.306049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.306049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.306049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:25:01.306049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:25:01.333263 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.333493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.333720 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.334189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.334428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.334670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.342895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.343818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.371959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.372186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.372401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.372640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.515525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.516824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.565172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.565411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.565690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.565928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.629714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.629942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.630995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.631214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.655856 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656591 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.656982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.657058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.657130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.657248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.657330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.657470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.668829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.669193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682575 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.682872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.683644 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 14:25:01.701022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.701231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:01.701315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.701525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:01.701622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.701752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:01.701863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702100 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 14:25:01.702278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702368 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.702863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.703075 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.713734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.713983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.714849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.722834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.723132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.726239 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.726459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.726543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.726744 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727109 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727830 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.727913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.728096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.728174 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.728366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.728984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.729171 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.729261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.729433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.729514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.729700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.756568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.756798 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.758193 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.758445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.758540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.758728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.763725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.764003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.764083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.764357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.764449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.764757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.771633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.771911 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.772099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.772385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.777109 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.777393 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.777475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.777671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.777767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.777948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.778841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.779025 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.779105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.779300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.798686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.798943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.799026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.799232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.803599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.803922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.807263 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.807553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.807634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.807933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.812661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.813115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.816259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.816766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.820001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.820295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.820439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.820576 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.820741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.820880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.821907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.841091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.841373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.841605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.841686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.841890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.841971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.842156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.842422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.849811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.850442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.851617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.851886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.852168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.852445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.855652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.855929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.856206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.856286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.856483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.856576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.856753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.856834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.857073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.857365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.870081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.870359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.870631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.870761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.870904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.871042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.871177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.871326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.871609 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.871892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.872700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.873029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.873494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.873791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.890877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.891790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.894150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.895123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.897436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.898474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.899305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.900220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.901486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.901766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.902043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.902421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.902705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.902997 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.909569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.910624 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.911154 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.912404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.914512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.914800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.915184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.915459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.915694 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.916588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.917008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.917301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.925126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.925415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.925691 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.926532 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.926826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.927109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.933674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.933953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.934231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.934505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.934774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 14:25:01.935146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.935982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936176 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936720 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.936863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.937979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.938256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.938524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.938793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 14:25:01.977256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560676bc89c0 pid: 80384 (default app) Jul 11 14:25:01.981355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f539e-d0ca-4e7c-b1f2-1de461e08760 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:01.981606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f539e-d0ca-4e7c-b1f2-1de461e08760 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:01.981890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f539e-d0ca-4e7c-b1f2-1de461e08760 None None] PATH_INFO: `/v3` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:01.982609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560676bc89c0 pid: 80385 (default app) Jul 11 14:25:01.986135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Mon Jul 11 14:25:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:09.586611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:09.587168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:09.587168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:09.592062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:09.598310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:09.598763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:09.598858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:09.672424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: INFO dbcounter [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] Registered counter for database keystone Jul 11 14:25:09.695335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG oslo_db.sqlalchemy.engines [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:25:09.702135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writer thread running {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:25:09.878566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG passlib.handlers.bcrypt [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80384) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:25:09.878909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG passlib.handlers.bcrypt [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80384) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:25:09.933264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:09.934878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.060380 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 14:25:10.277990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.355135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: INFO dbcounter [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] Registered counter for database keystone Jul 11 14:25:10.375352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG oslo_db.sqlalchemy.engines [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:25:10.381849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writer thread running {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:25:10.501048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95fb3-7a45-44b1-9ba0-cafc66819c7d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.505351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.506019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.506314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.506597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.514700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.567228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:25:10.567512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f6b15-53ea-4b39-b140-7720a11ed1f4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.577206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:25:10.583175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.597757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274117d8-85f9-4333-9e80-f4d8abb4162c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.602122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.603792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.604076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.604352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] PATH_INFO: `/v3/projects/75a3ebcd7160438e930735c88021e880` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.605862 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] RBAC: Authorizing `identity:get_project(project_id=75a3ebcd7160438e930735c88021e880)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.659114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 14:25:10.659452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141cd8-2f9f-4955-adfd-cc8ec0ae2807 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.663991 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/projects/75a3ebcd7160438e930735c88021e880 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:12.663074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ae5-41cb-4eaf-9602-3f5187a6c5d3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:12.663604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ae5-41cb-4eaf-9602-3f5187a6c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:12.663604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07ae5-41cb-4eaf-9602-3f5187a6c5d3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:12.668315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:12.673922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:12.674332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:12.674494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:12.693484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:12.695007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:12.702787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 14:25:12.724702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07ae5-41cb-4eaf-9602-3f5187a6c5d3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:12.737469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07ae5-41cb-4eaf-9602-3f5187a6c5d3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:12.741695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:12.742321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:12.742609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:12.742889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:12.751163 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:12.752972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50285be5-6e6b-44ee-a07e-fb5069ed3082 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:12.762182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Jul 11 14:25:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:12.767540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:12.777099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f70ff-8f70-4d02-b25d-012a392e0818 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:12.781763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:12.782627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:12.782914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:12.785390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:12.785390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:12.786433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bde14-deeb-4373-a449-219e751f9826 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:12.788004 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Jul 11 14:25:12 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:14.872523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe25e-7ea4-4d0c-b89a-9c830c7ace7a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:14.873126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe25e-7ea4-4d0c-b89a-9c830c7ace7a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:14.873362 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fe25e-7ea4-4d0c-b89a-9c830c7ace7a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:14.875018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:14.880800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:14.881285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:14.881412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:14.899257 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:14.901020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:14.914370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c4fa-6b16-4e4d-876b-40a874aa0eaa None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:14.914653 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c4fa-6b16-4e4d-876b-40a874aa0eaa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:14.915121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3c4fa-6b16-4e4d-876b-40a874aa0eaa None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:14.916494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:14.922105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:14.922389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:14.922665 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:14.963308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 14:25:14.963827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG passlib.handlers.bcrypt [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 14:25:14.985420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:15.008560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.010692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:15.012314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:15.039946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.114123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:15.129541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e43511-573b-4657-a3d9-87b549a7adaa None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.137053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.168352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.169197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.169489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.169771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.181296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:15.192616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:15.193803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:15.194630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:15.200811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.249968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4daa-102b-40f7-a94d-2aaeabe83a8d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.252279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.289086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.291200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.291919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.292211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.292494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.307932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8188de-f08f-493a-968a-b3467e12bd2e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.341457 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.342127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.342416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.342705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.343471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:15.343787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.345212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.357140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:15.361043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.362470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.362673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.464059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:25:15.464308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada6e0-701b-4245-9585-8027cf334a4b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.469658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.472445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.500646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.501626 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.501953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.502233 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.503470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.504949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.506584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:15.512268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.527762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.577361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb1c8-eb39-449c-8d0a-7b19e0a15b78 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.611592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.612386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.612502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba2b7d-ab1f-4b04-a004-cbf54568637b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.612671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.612978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.632351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.633848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:25:15.656103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:15.657086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:15.657880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:25:15.657880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:25:15.657880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:15.657880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:15.658153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.658153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.658303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 9/18] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:15.658372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.658372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.659174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.660690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.666759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 10/19] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:15.666900 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.667650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:15.719047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.746481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:15.762932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040230a7-c0d7-47e8-8e12-247afd1bc20b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.765901 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fff2b-a4ec-4aa5-ad77-d92c00753798 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:15.797123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.797790 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.798077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.798356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.799055 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:15.799177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:15.799377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.799708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:15.799996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:15.800275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:15.800753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426b9f-6ca3-4f56-8f54-ca766ae64925 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.801163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.domain.id=default, user.id=ab535bfd955b40ebbede39640e8b5ce8) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:15.801477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:15.802969 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35e5fe-4d2d-4777-bbdd-ef0568a05acd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:15.809750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/role_assignments?user.id=ab535bfd955b40ebbede39640e8b5ce8&scope.domain.id=default&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:15.818662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:18.173467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd003-b68d-4cfe-86a0-544848c38db9 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.173985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd003-b68d-4cfe-86a0-544848c38db9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.174227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd003-b68d-4cfe-86a0-544848c38db9 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.176030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:18.181636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d7c4-ac13-4516-85c9-7140663f1e77 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.182104 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d7c4-ac13-4516-85c9-7140663f1e77 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.182178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d7c4-ac13-4516-85c9-7140663f1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.205925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f611d7c4-ac13-4516-85c9-7140663f1e77 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:18.207128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f611d7c4-ac13-4516-85c9-7140663f1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:18.298356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:18.340780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd003-b68d-4cfe-86a0-544848c38db9 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:18.350750 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ddeb-97f0-4007-a6f9-0f338c2a2c36 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.351038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ddeb-97f0-4007-a6f9-0f338c2a2c36 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.351316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052ddeb-97f0-4007-a6f9-0f338c2a2c36 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.352754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 12/24] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:18.362198 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59e7d-deb3-44fa-9745-0639b432f3c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.362492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59e7d-deb3-44fa-9745-0639b432f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.362770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59e7d-deb3-44fa-9745-0639b432f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.382416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6dd59e7d-deb3-44fa-9745-0639b432f3c1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:18.383602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6dd59e7d-deb3-44fa-9745-0639b432f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:18.481219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:18.507504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd003-b68d-4cfe-86a0-544848c38db9 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:18.529357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 13/25] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:18.531287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef6ba-f7d1-442b-9d23-b391197faba8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.531779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef6ba-f7d1-442b-9d23-b391197faba8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.532256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef6ba-f7d1-442b-9d23-b391197faba8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.538147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 14/26] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:18.543276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.543826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.544315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.566520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:18.567331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.567616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.567888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.573448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:18.574895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:18.581504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:18.589751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:18.590627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:18.591372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 13/27] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:18.591978 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:18.597220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:18.697554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65bd7a-399f-4567-b750-bcfb169bc1a0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:18.737677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:18.738398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.738682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.738958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.746518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 15/28] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:18.750054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:18.756605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:18.758141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:25:18.793998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:18.794879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:18.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:25:18.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:25:18.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:25:18.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:18.795705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 14/29] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:18.796392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:18.885250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:18.927409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291e3a2-3bd4-4864-8396-52ccb64962e4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:18.966976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:18.968116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:18.968614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:18.969165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:18.970768 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:18.973404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:18.988673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182f2e-9b61-44eb-82ae-3b9449b94795 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.015479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:19.077644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.078690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.079209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.079688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.080675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:19.081201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.082809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.106286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 16/30] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:19.107452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.164329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 15/31] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:18 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:19.168743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.349964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32722-c48a-488a-8d87-bce4346f4729 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.377269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84f74-5764-4d54-b63e-d29e412b902e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.389109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:19.409453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.410341 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.410629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.410910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.412217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.413799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908a514-8f31-4133-9310-857fa85b5f12 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.417108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 16/32] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:19 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:19.418459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59eeb8-9216-4ae5-b29b-8683fe82e527 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.418753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59eeb8-9216-4ae5-b29b-8683fe82e527 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.419031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59eeb8-9216-4ae5-b29b-8683fe82e527 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.420294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 17/33] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:19.425513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59eeb8-9216-4ae5-b29b-8683fe82e527 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.429931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.430663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.431455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.431733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.432469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:19.432775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.434222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0b72-30fc-41b4-82d4-c70f60692b38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.446391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 17/34] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:19.447797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.448085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.448365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.465327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:19.466628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:19.491771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:19.547053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59eeb8-9216-4ae5-b29b-8683fe82e527 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.562300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 18/35] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:19.562300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.611914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.612844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.613319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.613689 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.615201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.617016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.619592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 18/36] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:19.620304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.685301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:19.687623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3120-e032-46b7-9bb7-72262dfe838d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.725451 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.726482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.727942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.728407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.729615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.731269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af13e31-fe2b-498d-a8c7-528aa2e5340d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.739654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de5344-966c-43a8-8514-f3d884bb868f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:19.775505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:19.776179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.776467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.776745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.777537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:19.778955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:19.792619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:19 2022] POST /identity/v3/roles => generated 225 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:19.794430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:19.873206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 19/38] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:19 2022] POST /identity/v3/projects => generated 301 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:19.874888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6b34-12fa-4335-a5ca-41830a6e381f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.875262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6b34-12fa-4335-a5ca-41830a6e381f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.875532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6b34-12fa-4335-a5ca-41830a6e381f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.881319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 20/39] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:19.881319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2945-2ea8-4960-ae56-0c50c77d42b7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.881319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2945-2ea8-4960-ae56-0c50c77d42b7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.881319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2945-2ea8-4960-ae56-0c50c77d42b7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.881319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 21/40] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:19.882714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df84fc-839a-4699-8268-378817ca0ef5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:19.883012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df84fc-839a-4699-8268-378817ca0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:19.883296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df84fc-839a-4699-8268-378817ca0ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:19.906625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-61df84fc-839a-4699-8268-378817ca0ef5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:19.908462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-61df84fc-839a-4699-8268-378817ca0ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:19.912253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:20.008904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 22/41] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:20.010674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.011241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.011712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.031683 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:20.033007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:20.061049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d37a0a-b39c-4577-9528-fc255a1006fa None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.076290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:20.106852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.107749 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.108044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.108333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] PATH_INFO: `/v3/domains/default/users/ab535bfd955b40ebbede39640e8b5ce8/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.110700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab535bfd955b40ebbede39640e8b5ce8, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.112161 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 23/42] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:20.120100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:20.146442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 20/43] 10.222.0.73 () {58 vars in 1361 bytes} [Mon Jul 11 14:25:19 2022] PUT /identity/v3/domains/default/users/ab535bfd955b40ebbede39640e8b5ce8/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:20.147763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:20.203995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:20.238873 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9f23-1ba3-4176-abb0-bf5265af1d90 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.266480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e23c-a2c3-4c2e-9796-9d248c010371 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.279142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.280229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.280523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.280803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.282135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.283894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.285751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 24/44] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:20.291947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:20.314531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.315215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.315505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.315786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.316550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.317992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b8d73-9058-406c-9e23-8902ecedac6d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.332727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 21/45] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Jul 11 14:25:20 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:20.419555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a8c5f-40f8-4140-86ef-86270dbe6cdc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.458081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.458771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.459060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.459346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.460086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.461607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623d832-88c5-44f7-863b-c5bbe883bfd0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:20.496522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 25/46] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:20 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:22.190822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1321-8a27-44de-b8d9-67d08280ac5f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.191308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1321-8a27-44de-b8d9-67d08280ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.191308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1321-8a27-44de-b8d9-67d08280ac5f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.192693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 22/47] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:22.198338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.198706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.198909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.216305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:22.217554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.282555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 26/48] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:22.305379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1321-8a27-44de-b8d9-67d08280ac5f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.337544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.409285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1321-8a27-44de-b8d9-67d08280ac5f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.442685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.443407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.443699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.443984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.454084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-11370eeb-4104-4129-a76d-cba20fd276aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:22.461839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:22.462715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:22.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 23/49] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:22.468789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.530670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c885-57bb-41e9-a653-2c6047222828 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.530965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c885-57bb-41e9-a653-2c6047222828 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.531257 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c885-57bb-41e9-a653-2c6047222828 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.532646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 24/50] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:22.537433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.537723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.538003 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.556821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:22.558390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.568916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c0dff-2a66-4c59-9b63-19f1e935d25b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.589940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.604992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.605661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.605950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.606232 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.606992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:22.607305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.608701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.617168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 27/51] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:22.623296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.632702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 25/52] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:22.656351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.682411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.761141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd116c-e3ad-4c4f-b637-c5d6e012713e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.795815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.796608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.796914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.797197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.798378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.799849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.801501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:22.806987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.827608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03251d95-620e-49b0-89e3-e325f7a0d084 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.860805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.861705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.861994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.862269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.863691 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.865175 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.866937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 28/54] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:22.872232 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.895631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.906307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48706e21-e438-425a-9510-b8754e1f2e1f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.922241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.940389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.941078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.941374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.941655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.942372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.943824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.970336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 27/55] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:22.972091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b6ef-f1de-4260-8c77-10bfef86f5de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.009810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.010633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.010929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.011266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.012760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.014291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f79122-612d-4581-9142-2aa89824de30 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.016038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 29/56] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:23.022168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.127805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867433-5f08-45af-9860-f8ac3413c4d4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.164445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.165241 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.165531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.165833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.166708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.domain.id=default, user.id=ab535bfd955b40ebbede39640e8b5ce8) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:23.167024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.168474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7da852-eb25-41da-9e77-e73035fd93e3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.174525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Jul 11 14:25:23 2022] GET /identity/v3/role_assignments?user.id=ab535bfd955b40ebbede39640e8b5ce8&scope.domain.id=default&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:25.015229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd32d1b-a669-47f3-97bc-b0eed7bcf373 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.015725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd32d1b-a669-47f3-97bc-b0eed7bcf373 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.015808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd32d1b-a669-47f3-97bc-b0eed7bcf373 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.017217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 30/58] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:25.022228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.022642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.022800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.034768 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.040310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:25.041940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.105550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 29/59] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:25.129717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd32d1b-a669-47f3-97bc-b0eed7bcf373 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.228796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd32d1b-a669-47f3-97bc-b0eed7bcf373 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.245781 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.262816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.263607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.263903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.264186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.265437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.266842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95e2f-39b5-44f4-80e9-0414f900ca7a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.268471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 31/60] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:25.273896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.371578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564c9f-8134-4728-bcd3-e3ad99671209 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.409651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.410566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.411094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.411597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.413000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.414596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b37f57-4df1-4ef5-8563-3199bf865ee4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.425632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.441754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 30/61] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:25 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:28.589090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09154-7532-4de2-b511-e3a4d1664cb0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.590092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09154-7532-4de2-b511-e3a4d1664cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.590606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09154-7532-4de2-b511-e3a4d1664cb0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.592202 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 32/62] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:28.597617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.598442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.598946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.623210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:28.624779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:28.644619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310e78-9c2d-496c-af11-6f517b3a538a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.645237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310e78-9c2d-496c-af11-6f517b3a538a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.645746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310e78-9c2d-496c-af11-6f517b3a538a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.647649 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 33/63] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:28.653050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.653736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.654228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.681031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:28.682242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:28.734949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 31/64] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:28.765966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.815774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 34/65] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:28.844600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.945400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145e597-ea40-4200-97b9-4422a181f3d8 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.986673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.009206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.011024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.011915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.012647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.021164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bbeea-5f2d-47fa-9ff5-239cf89de498 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.031618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-48c052a7-393a-4f29-bdb9-8b959790141d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:29.047133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:29.049041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:29.050910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:29.053804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 32/66] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:29.056128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.058180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73c35-3b6e-4442-8ded-cb809b0bb33c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.059201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73c35-3b6e-4442-8ded-cb809b0bb33c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.059970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73c35-3b6e-4442-8ded-cb809b0bb33c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.063391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 33/67] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.065081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73c35-3b6e-4442-8ded-cb809b0bb33c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.080571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.081406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.081694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.081973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.096169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fd602c37-1c45-4379-bfcd-4a4d6f67b923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:29.105682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:29.113849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 35/68] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:29.115541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.116965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.116965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.137057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.138396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.214460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 36/69] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:29.215429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.234201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73c35-3b6e-4442-8ded-cb809b0bb33c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.276754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.278989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.279756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.280147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.280980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:29.281300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.282720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e12a2d-53b4-4487-b2d8-1848cce71e59 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.292486 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 34/70] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.293904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fb5c-a1fc-42e2-862e-a0305aa4ac87 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.294324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fb5c-a1fc-42e2-862e-a0305aa4ac87 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.294476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6fb5c-a1fc-42e2-862e-a0305aa4ac87 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.295812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 35/71] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.297015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6fb5c-a1fc-42e2-862e-a0305aa4ac87 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.335539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b06a-e8e0-4b7e-b94f-9dc5dd3fb912 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.343157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.360215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.376214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.376988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.377322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.377602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.378367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:29.378677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.380086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11042a-c68c-46d1-a847-15e2c893d423 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.388686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 37/72] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.390055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f498-1c0c-4e2b-ac3d-9e1a1fc5cb09 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.390341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f498-1c0c-4e2b-ac3d-9e1a1fc5cb09 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.390622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f498-1c0c-4e2b-ac3d-9e1a1fc5cb09 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.392076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 38/73] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:29.394075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f498-1c0c-4e2b-ac3d-9e1a1fc5cb09 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.421321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6fb5c-a1fc-42e2-862e-a0305aa4ac87 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.465970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.466785 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.467076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.467358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.481992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-fc325eda-0d00-4ea9-bf88-d959b8709f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:29.490329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:29.491566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:29.492325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 36/74] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:29.493693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24a96-afc2-4f7d-8799-750955caf27f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.493693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24a96-afc2-4f7d-8799-750955caf27f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.493693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca24a96-afc2-4f7d-8799-750955caf27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.510419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f498-1c0c-4e2b-ac3d-9e1a1fc5cb09 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.515373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-3ca24a96-afc2-4f7d-8799-750955caf27f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.516592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-3ca24a96-afc2-4f7d-8799-750955caf27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.547176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.548062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.548391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.548942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.566091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.567569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.569357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 39/75] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.570124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.603366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.617352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 37/76] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:29.617352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.617352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.617352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.623079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.624359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.650300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.689566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dfcc1-938b-438c-bea4-b7e576bdcba1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.689852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 38/77] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:29.690668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.726231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.727913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.728205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.728487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.729763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.731215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.732894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 40/78] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.733729 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.795386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4ee60-c74d-4032-9dd6-ffc3f0583378 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.825176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.831880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.832032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebafb2-e352-4993-a670-5da284ccf5f4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.832566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.832876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.833165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.833933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:29.834256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.835674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.844654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 39/79] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.845306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.867219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.868530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.868816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.869121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.874063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.937835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.939295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.947361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd08c-6672-491e-a26d-e7aa826aa7b9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.981201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.981992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.982277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.982552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.983730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.985205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.986821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 40/80] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:29.986821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.032722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.040220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 41/81] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:30.041123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.080331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.088130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796443e8-d92d-40b3-b729-769677a52831 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.119804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.120588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.120890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.121174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.131088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:30.139198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:30.140301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:30.141133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 41/82] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:30.141754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.144393 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33473d-e114-44dd-86e0-a21f70c33f2c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.179260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.179916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.180228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.180509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.238849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.242283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db0b3-8c33-429f-8960-b3b145086281 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.246918 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.248372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.277145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.278026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.278317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.278603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.280062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.281552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.283193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 42/83] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:30.283928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.309760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.345332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 42/84] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:30.346102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.388460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a90f-eee8-4deb-8c37-c69c03726664 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.421950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.423055 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.423541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.424023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.425421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.428153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.440343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.448612 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516aa2c3-4a9c-4b6e-aaeb-456d653fd9d7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.451027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 43/85] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:30 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:30.451861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.500242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.501275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.501629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.501972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.503508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.505044 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.507282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 43/86] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:30.508475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.546102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.573120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae815f-b89d-452c-a9c0-fe1a0ab5a60a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.617357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.618038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.618479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.618897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.619821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:30.620140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.621605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.625500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff458592-4c15-4db2-8975-69270d23cc28 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.631249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 44/87] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:30.632095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.671186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.671854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.672148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.672432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.711812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.761538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.762671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.763143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad0207-2450-4eb2-8040-e920856c7e61 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.810960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.812661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.813262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.814140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.815858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.818600 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.821436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 45/88] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:30.822561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.838412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.878367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 44/89] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:30.879367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.954879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e8599-8084-49e4-98ed-2eac770a20c4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.956983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.000526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882843f-1046-476e-991e-014316b332c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.001777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882843f-1046-476e-991e-014316b332c1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.002239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882843f-1046-476e-991e-014316b332c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.002959 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882843f-1046-476e-991e-014316b332c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.004669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882843f-1046-476e-991e-014316b332c1 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.005196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882843f-1046-476e-991e-014316b332c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.006329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6343-ce89-4341-beca-790f9f652531 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.007296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882843f-1046-476e-991e-014316b332c1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.017943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 46/90] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.019582 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882843f-1046-476e-991e-014316b332c1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.055503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.056352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.056645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.056955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.061800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.064074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.065385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 45/91] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:30 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.066205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.104011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.157016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882843f-1046-476e-991e-014316b332c1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.215502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.216751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.217154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.217507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.218438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=ab535bfd955b40ebbede39640e8b5ce8) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.219175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.221067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.228724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 47/92] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/role_assignments?user.id=ab535bfd955b40ebbede39640e8b5ce8&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.229562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.264814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4322-b9fc-4c1a-a96a-17d2f019440c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.354484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.363403 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc882-a521-4eec-a7bb-8b50e5f68365 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.374541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.375723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.376208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.376690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.382637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.384991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.387003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 46/93] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.392592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.455431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.456032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.456323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.456611 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.477265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.555880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.557483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.667214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 48/94] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:31.672954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.690811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3773-ad87-4226-a649-6a870ab87354 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.725511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.782172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.783081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.783510 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.783942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.784969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.785425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.787335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.790090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dcd03-980e-4db2-b538-28503a70693e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.812544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 47/95] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=7f83d786d22243dab58a39a437993025 => generated 259 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:31.852554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.853521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.854303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.854303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] PATH_INFO: `/v3/projects/cbea9e5969fb40b2a1dec1c650327f90` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.858622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] RBAC: Authorizing `identity:get_project(project_id=cbea9e5969fb40b2a1dec1c650327f90)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.860114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a2da-adf6-40f1-bc43-6a3eda4c1895 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.861905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 49/96] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/projects/cbea9e5969fb40b2a1dec1c650327f90 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:31.869167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.936998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.993529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427b18-0333-4612-922d-e9d9ea60181a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.036306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.037223 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.037513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.037842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.038703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=cbea9e5969fb40b2a1dec1c650327f90, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:32.039021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.041325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef6a7a-6a4d-450c-bdf7-16ac9bec8a16 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.047590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 48/97] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=cbea9e5969fb40b2a1dec1c650327f90&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:33.177941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431db93-54a5-4991-9b73-7141755c98f9 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.178452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431db93-54a5-4991-9b73-7141755c98f9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.178525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431db93-54a5-4991-9b73-7141755c98f9 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.180096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 50/98] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:33.186180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99698-bbf7-40a8-8818-090f01a623fa None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.186609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99698-bbf7-40a8-8818-090f01a623fa None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.186807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99698-bbf7-40a8-8818-090f01a623fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.209059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-42f99698-bbf7-40a8-8818-090f01a623fa None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:33.210267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-42f99698-bbf7-40a8-8818-090f01a623fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:33.308400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 49/99] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:33.344569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431db93-54a5-4991-9b73-7141755c98f9 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:33.435564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691efd-5285-4598-9e47-024b0acd7f2e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.435842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691efd-5285-4598-9e47-024b0acd7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.436050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61691efd-5285-4598-9e47-024b0acd7f2e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.437464 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 50/100] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:33.442349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.442868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.443499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.467359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:33.469697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:33.502739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431db93-54a5-4991-9b73-7141755c98f9 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:33.506477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:33.567325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:33.568271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.568843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.571796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:33.573262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:33.575763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 51/101] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:33.576318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:33.581738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:33.610978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 51/102] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:33.651217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:33.812876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddcde-ebf1-4587-aa32-3ddf0fedb288 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:33.941572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:33.942263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:33.942560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:33.942851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:33.943589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:33.945104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:33.947718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce1d65-703a-42e0-8de3-bc6f1bb1b8e5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.022518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 52/103] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:25:33 2022] POST /identity/v3/projects => generated 302 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:34.053342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.054483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.054947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.055449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.075703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-692036a7-3144-48ad-8c49-6623b516dbfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:34.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:34.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:34.095916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:34.098352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 52/104] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:34.114043 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.168093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.233160 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c8a3-457d-405b-a5c3-0da0cf4517e4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.234041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c8a3-457d-405b-a5c3-0da0cf4517e4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.234470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c8a3-457d-405b-a5c3-0da0cf4517e4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.236066 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 53/105] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:34.242106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229eda2-8aad-4023-ac7d-c5d3388d8cb5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.245253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229eda2-8aad-4023-ac7d-c5d3388d8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.245811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229eda2-8aad-4023-ac7d-c5d3388d8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.273258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07af7b-27e1-4451-ab12-e3f4a6b12479 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.297938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8229eda2-8aad-4023-ac7d-c5d3388d8cb5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:34.299170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8229eda2-8aad-4023-ac7d-c5d3388d8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:34.318865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.319933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.320461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.321010 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.322125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:34.322639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:34.324929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:34.334529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 53/106] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:34.341261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.392629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.440427 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.446837 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 54/107] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:34.448399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3fda-8045-4ffe-ad16-304f7db3dc07 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.448840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3fda-8045-4ffe-ad16-304f7db3dc07 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.449291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3fda-8045-4ffe-ad16-304f7db3dc07 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.450727 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 55/108] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:34.458287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.458913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.459344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.471848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507dbbb-04e8-4627-8ace-6cd86c7db5ca None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.514007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:34.515226 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:34.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.531894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] PATH_INFO: `/v3/users/e31896239a994a55961ba0933907d8f2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.563715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=e31896239a994a55961ba0933907d8f2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:34.565225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:34.573774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 54/109] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/users/e31896239a994a55961ba0933907d8f2 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:34.574667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.722230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 56/110] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:34.723039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.749629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07c432-cfac-4704-b3a9-676fc9f4bdf2 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.791324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.793518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.794071 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.795234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:34.818513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:34.833625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:34.834711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:34.835562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:34.839630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 55/111] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:34.846135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:34.853937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.919648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2975afc-9ceb-40fa-a7fb-70e26ab9e297 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:34.928577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:34.962064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:34.962997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:34.963444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:34.963869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.048192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.049700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92dfa8-d7b5-42f7-a79c-8ee0de302511 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.072589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92abc-bae2-4449-8e03-27d283c34bcb None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.124631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.126416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.127068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.127624 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.143191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:35.154511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:35.155401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:35.156127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:35.159346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 56/112] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:35.164754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.185871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 57/113] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:35.189080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef2d0-2c2a-47c5-893b-0d5f2a6d4707 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.190273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef2d0-2c2a-47c5-893b-0d5f2a6d4707 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.190819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bef2d0-2c2a-47c5-893b-0d5f2a6d4707 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.193759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 58/114] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:35.194599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef2d0-2c2a-47c5-893b-0d5f2a6d4707 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.204963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.245912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.296162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327a0bd-bb5d-48f4-9fbb-ec48dcfb17b0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.335558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.335842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.336824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.336824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.337610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:35.337927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.339334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.343890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bef2d0-2c2a-47c5-893b-0d5f2a6d4707 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.354124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 57/115] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.354124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.392869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.393672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.393963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.394250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.395029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:35.395337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.396746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91567-9983-487d-b0e0-a88b10ab68ea None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.409192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 59/116] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.409192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed69fe-0ee9-4aae-9804-8453512cacea None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.409567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed69fe-0ee9-4aae-9804-8453512cacea None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.409765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed69fe-0ee9-4aae-9804-8453512cacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.429628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-37ed69fe-0ee9-4aae-9804-8453512cacea None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:35.430923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37ed69fe-0ee9-4aae-9804-8453512cacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:35.485969 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b37ad-16fb-4b28-824e-e4ebfa86f620 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.510371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.517673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 60/117] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:35.519508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572f6c-1bd4-49c1-93cd-c409314d3ea7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.520187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572f6c-1bd4-49c1-93cd-c409314d3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.520490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572f6c-1bd4-49c1-93cd-c409314d3ea7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.522369 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 61/118] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:35.522941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572f6c-1bd4-49c1-93cd-c409314d3ea7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.530138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.545069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.546948 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.547445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.547957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.550158 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.551845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.554005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 58/119] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.555517 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.666884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572f6c-1bd4-49c1-93cd-c409314d3ea7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.693570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b22c10-e1e0-4748-8658-a122068a4e55 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.713238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.714125 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.714417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.714727 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.715978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.717496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5980a0-24e4-4830-a4ed-4d17e91e4d4e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.719160 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 62/120] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.720352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.720647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.720956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.738339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:35.739556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:35.748103 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.749494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.750009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.750484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.752022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:35.753811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:35.755852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 59/121] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:35.757016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.823015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.836894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 63/122] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:35.836894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:35.858912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:35.902634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2cf5-d608-4b90-a589-1f2f9df2bca4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.941125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:35.942231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:35.942231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:35.942480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:35.956737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:35.965123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:35.965995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:35.966773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:35.971524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf553f-fcbc-442e-9c8c-69c521ec2bc2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:35.971654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 60/123] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:35.972009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.012170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.013119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.013408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.013690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.014545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=e31896239a994a55961ba0933907d8f2) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:36.014860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.016309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.022303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 64/124] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/role_assignments?user.id=e31896239a994a55961ba0933907d8f2&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.024158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.102325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.112278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d0b1f-c251-496e-8865-06e1f5da266d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.140431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.153182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414f4c-67bd-495f-a528-0b47263d7d09 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.156425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.157970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.158581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.159086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.160713 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.162649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.165500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 61/125] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:35 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.166668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.192680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.193910 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.193910 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.194210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.196207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.197701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.199679 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 65/126] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.200331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.298071 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049eac-e7db-4f32-8fa3-1e2b83d97c2a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.314105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883203-9e84-4f4c-91bc-a8c6f3619eec None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.335839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.337394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.337781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.338223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.341473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.350966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.352234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.352642 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.352946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:36.353067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.353885 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:36.354302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.355745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:36.361693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:36.362601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:36.363379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 62/127] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:36.364025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.370380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 66/128] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.371248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.427173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.480607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa0ce-246d-4f7a-b26d-1f2435dea443 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.486356 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02915-e662-4f0b-a682-ae045e0fab72 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.517299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.518324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.518617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.518897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.521223 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.522801 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.527518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.528630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.528947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.529764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/ab535bfd955b40ebbede39640e8b5ce8/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.532025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, user_id=ab535bfd955b40ebbede39640e8b5ce8, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.533655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.541542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 67/129] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:36 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:36.542915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.549880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 63/130] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:36 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/ab535bfd955b40ebbede39640e8b5ce8/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:36.558344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.665277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.732335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf3f6-aa82-4999-b130-9575384fe2b5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.732530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdded9-b962-4403-9ec4-0d8d4dc79ea3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.752752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.773676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.774378 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.774676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.774964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.775739 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:36.776057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.777488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8366b5-005f-491e-a834-2b267e2714bb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.786743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 68/131] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.788246 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d95ab-5b09-4711-b8c8-753f81a51f04 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.788549 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d95ab-5b09-4711-b8c8-753f81a51f04 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.788837 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d95ab-5b09-4711-b8c8-753f81a51f04 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.790821 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 69/132] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:36.792617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.793553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.793839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.794114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.794463 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d95ab-5b09-4711-b8c8-753f81a51f04 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.795802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.797301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca348e48-6e33-402a-9070-8146955df5ae None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.799369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 64/133] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:36.800109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.800396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.800676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.820743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:36.820977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:36.935023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 65/134] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:36.937521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.958840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d95ab-5b09-4711-b8c8-753f81a51f04 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.984033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.026428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.027687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.028189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.028674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.030374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.035685 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.038697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 70/135] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:37.040248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.112401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5edcc-8964-491c-a8c3-e6698b93e58a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.126467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.158126 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.159199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.159199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.159199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.162108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.163581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.166220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 66/136] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:37.166993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.195170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f516ec-ac3c-4766-98bf-8870abb40522 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.269656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.270399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.270694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.270977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.272237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.274286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.276989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 71/137] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:37.277774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.301388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d808f2-4929-4aeb-9d2e-7bc686c673cf None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.338640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.339668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.339959 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.340242 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] PATH_INFO: `/v3/projects/cbea9e5969fb40b2a1dec1c650327f90` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.341596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] RBAC: Authorizing `identity:get_project(project_id=cbea9e5969fb40b2a1dec1c650327f90)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.343173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.345452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 67/138] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:37 2022] GET /identity/v3/projects/cbea9e5969fb40b2a1dec1c650327f90 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:37.346228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.370892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.400869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.470073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c82c9-faa6-4405-bacf-30bb52403572 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.491328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bb934-e4d9-4482-82cf-be73dd30652a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.541668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.542266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.542555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.542830 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.543550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.545850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.561914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.562819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.563103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.563383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/7f83d786d22243dab58a39a437993025` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.567809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808, role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.572207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc32f1f-c2f7-45e3-80a1-4ba4d7734b02 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.588053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 68/139] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:37 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:37.588690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.595831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 72/140] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:37 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/7f83d786d22243dab58a39a437993025 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:37.726276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.730631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414445d3-2b39-438d-87b3-5379fdb93cac None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.776827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.777828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.778119 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.778400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] PATH_INFO: `/v3/projects/cbea9e5969fb40b2a1dec1c650327f90/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.786568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbea9e5969fb40b2a1dec1c650327f90, user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.788060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d54d-84c8-474d-8b23-fca7fe2fd773 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.806826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 69/141] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:37 2022] PUT /identity/v3/projects/cbea9e5969fb40b2a1dec1c650327f90/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:38.629416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830a8f-7e4e-40ef-ab59-ba2de088064a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.629933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830a8f-7e4e-40ef-ab59-ba2de088064a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.630014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef830a8f-7e4e-40ef-ab59-ba2de088064a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.631526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 73/142] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:38.637054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.637480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.637674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.660387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:38.661610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:38.742864 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 70/143] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:38.778377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830a8f-7e4e-40ef-ab59-ba2de088064a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.934527 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef830a8f-7e4e-40ef-ab59-ba2de088064a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.944504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.975661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.976513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.976879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.977173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.994609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d0b3d636-615c-4642-ad71-debfd0b6222e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:39.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:39.003330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:39.004060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 74/144] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:39.011469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.150428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:39.165139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9a1c-4bc5-46a0-9e83-ba98ab7aac4b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.186501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ccfd-3201-4aee-93cb-d2c1c9328af6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.186855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ccfd-3201-4aee-93cb-d2c1c9328af6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.187082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28ccfd-3201-4aee-93cb-d2c1c9328af6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.188640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 75/145] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:39.196080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.196377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.196651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.207943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.209173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.209173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.209421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.210119 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:39.210423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.212398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.225264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 71/146] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:39.232261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.237898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:39.239112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:39.359471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 76/147] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:39.410777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.423147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82175466-6fa0-48f2-b809-b0a18dd4fe56 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.557671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.558824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.559328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.559802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] PATH_INFO: `/v3/users/e31896239a994a55961ba0933907d8f2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.561276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] RBAC: Authorizing `identity:get_user(user_id=e31896239a994a55961ba0933907d8f2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.562922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.563225 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:39.565254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 72/148] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/users/e31896239a994a55961ba0933907d8f2 => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:39.568916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0594a3-b751-41f5-8fd6-f6c015e08c79 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.571814 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.610262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.610998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.611287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.611565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.616000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:39.627277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3e8b3f6c-271f-4ba1-9dd4-a394c4b5e9b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:39.637134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:39.638606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:39.639635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:39.642283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 77/149] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:39.643730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae342-fa0e-40f4-b7af-947f36589d09 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.644168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae342-fa0e-40f4-b7af-947f36589d09 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.644600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bae342-fa0e-40f4-b7af-947f36589d09 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.646072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 78/150] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:39.651559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.652035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.652491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.672199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:39.673711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:39.749775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 79/151] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:39.750922 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.777822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3c7b-0cce-40ab-98a6-9bacc9e9f688 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.850874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:39.865099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.866313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.866808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.867688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7797f6-b03e-421d-ae4d-a6abd1f15ec1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.867958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.873628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.875346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.877390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 73/152] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:39.878353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.906159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.907089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.907659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.908083 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.909139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:39.909633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.911226 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.921462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 80/153] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:39.922581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.036717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16386e54-55e5-4525-b994-a850457d0416 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.044985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.075112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319275e7-df3b-4ce5-b162-86456c3fc1ce None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.076839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.077989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.078455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.078906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/e31896239a994a55961ba0933907d8f2/roles/c69e3298ff7145e5b2478a6f5635eb57` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.081276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, user_id=e31896239a994a55961ba0933907d8f2, role_id=c69e3298ff7145e5b2478a6f5635eb57)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.082932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.100807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 81/154] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:39 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/users/e31896239a994a55961ba0933907d8f2/roles/c69e3298ff7145e5b2478a6f5635eb57 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:40.102770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.118619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.146029 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.146906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.147185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.147505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.169061 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:40.181428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:40.182396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:40.183376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 74/155] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:40.189018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.235057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84311-3298-4c58-8649-abcdc68f2b48 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.274121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.275259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.275691 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.276219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.277676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.279611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.281681 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 82/156] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:40.288499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.380188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.406889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275080-3a66-464e-aebf-e1e7a25ea19e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.417008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c72a4-d40a-413e-afcc-1be5d5d15628 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.445459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.446390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.446831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.447328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.485470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.485470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.485470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.485470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.485757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:40.485757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.485757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.501573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 75/157] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:40.507389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.529834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.538723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.541014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.643062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.674832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 83/158] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:40.688560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.700727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d5be-287f-4dcd-8d66-31d5442841fe None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.761618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.762618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.762908 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.763183 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] PATH_INFO: `/v3/users/ab535bfd955b40ebbede39640e8b5ce8` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.765856 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] RBAC: Authorizing `identity:get_user(user_id=ab535bfd955b40ebbede39640e8b5ce8)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.767433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.769348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 76/159] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/users/ab535bfd955b40ebbede39640e8b5ce8 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:40.775389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.843281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b91da4-4b26-48cb-a0ea-1894f771f768 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.907289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.941988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89faa10-fd44-4469-b367-0ee4596ab917 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.958142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.959035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.959321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.959600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.965644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.967134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.969255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 84/160] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:40.975047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.996894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.997562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.997861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.998120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.108180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.109701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c99c2b-400b-46a7-ba88-1684a108f436 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.115587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:41.261179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343796d-e937-47c4-9907-6da4d6a851bb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.300192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:41.341375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 77/161] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:25:41.343073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb82357-6dbb-4a84-89f2-96c5f5331f67 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.343621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb82357-6dbb-4a84-89f2-96c5f5331f67 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.344205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb82357-6dbb-4a84-89f2-96c5f5331f67 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.347550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 78/162] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:41.353165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.353790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.354409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.365662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.366359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.366652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.366967 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.367845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:41.373052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.373052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.376653 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 85/163] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:41.383394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:41.385108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:41.393019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:41.496137 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 79/164] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:41.532153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:41.566763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21627baf-6157-41d7-8a5f-c3e59a814a5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.583001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:41.630379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.631281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.631570 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.631850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.634489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.635946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.638675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 86/165] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:41 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:41.643614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:41.790844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64bddb-ed5e-4dcc-9aa4-63b9a98df234 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.795275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f610-ce5c-42ae-8371-970fc2b7ff1e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.806343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:41.857631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.858372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.864019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.864363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=ab535bfd955b40ebbede39640e8b5ce8) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:41.865615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.867082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.873876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 87/166] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:41 2022] GET /identity/v3/role_assignments?user.id=ab535bfd955b40ebbede39640e8b5ce8&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:41.893580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.894418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.894699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.894967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.921817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:41.930193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:41.931164 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:41.932127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:41.937409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 80/167] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:41.943574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.017002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.103447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3617f4-e303-4696-ae7b-22a9e47cad0b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.168622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.169356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.169647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.169932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.170713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:42.171026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.172425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd29758-4238-451f-8d5a-efe6fd5dccc7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.186639 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 88/168] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:42.197988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.206794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43967-4537-4c23-aafb-6e8a97289aac None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.207084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43967-4537-4c23-aafb-6e8a97289aac None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.207356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb43967-4537-4c23-aafb-6e8a97289aac None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.208772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 89/169] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:42.227143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.227460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.227697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.258508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.259749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.363267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 90/170] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:42.398905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.408902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd87d-6d15-474b-8895-3e90f78a3e7a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.465553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.514500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.515401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.515682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.515955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.517211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.518675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.520316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 81/171] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:42.530140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.551270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e357-4a10-40a7-940a-dcef06307f70 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.581711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.606573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.607391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.607682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.607964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.630289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:42.642757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:42.644180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:42.646452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 91/172] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:42.652872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.693006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8574-9b3b-43c2-b877-3d5cca9042df None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.730039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.730924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.731426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.731706 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.821907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.823393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f75a24-e296-4173-9bd2-92585623ec1e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.826509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.840271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6e76-0d7e-457a-851f-fc7d25e1f9f9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.883474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.884471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.884993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.885483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.886437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:42.886937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.887378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.888726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022647ad-f2fa-4503-a11b-2c5fbe7c4570 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.897809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 92/173] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:42.899514 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a001-4ab3-4ab2-9ee3-a5f2acf1edcc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.899994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a001-4ab3-4ab2-9ee3-a5f2acf1edcc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.900458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a001-4ab3-4ab2-9ee3-a5f2acf1edcc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.902337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 93/174] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:42.903259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1a001-4ab3-4ab2-9ee3-a5f2acf1edcc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.032582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1a001-4ab3-4ab2-9ee3-a5f2acf1edcc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.044987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 82/175] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:43.049239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.049810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.050321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.084235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.086306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.101378 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.102588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.103559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.105035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] PATH_INFO: `/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.108105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] RBAC: Authorizing `identity:get_user(user_id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.111063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.113030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 94/176] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/users/fe78eae3bd8c4ef2bc2b7bc1e0dfa808 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:43.113976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.140410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.222149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 83/177] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.222830 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada88419-eb87-41b5-939a-f0165922bb4c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.223396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.277548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.278789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.279521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.280003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.281506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.283229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc3913-63d9-444d-a008-ba97b0e48cfc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.285441 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 95/178] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.286819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf463-c284-4e38-8619-10515bd9a0c3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.287309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf463-c284-4e38-8619-10515bd9a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.287785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf463-c284-4e38-8619-10515bd9a0c3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.289885 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 96/179] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:43.290783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf463-c284-4e38-8619-10515bd9a0c3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.324591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.364746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef84540-e52d-4a51-a256-19114da1d407 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.405680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.406255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.406610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.406817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.408312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.419367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf463-c284-4e38-8619-10515bd9a0c3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.456953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.457758 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.458051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.458471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.469693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9b6d8a16-be9f-491b-8e74-ece0b8c8177e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:43.478460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:43.479365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:43.480118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 97/180] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:43.481692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.481692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.481692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.491355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.493447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c655-57b2-4132-bea2-bedccba4032f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.500075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.501290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.562537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.576928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 98/181] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.578133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.607391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 84/182] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:43.609090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b099fd-7749-4f87-ad06-9d39ddab71ca None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.609585 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b099fd-7749-4f87-ad06-9d39ddab71ca None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.610060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b099fd-7749-4f87-ad06-9d39ddab71ca None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.611554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 85/183] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:43.612495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b099fd-7749-4f87-ad06-9d39ddab71ca None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.675587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.697177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0879a-e3ea-48ea-80f6-100f871e7424 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.720786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b099fd-7749-4f87-ad06-9d39ddab71ca None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.735376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.736319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.736319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.736574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.737454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:43.737766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.739209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa579-ef82-48f2-a717-1b41b92f0db8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.746468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 99/184] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=7f83d786d22243dab58a39a437993025 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.746468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.746468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.746468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.767265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.768615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.770290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.771593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.773569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.773862 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.774745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:43.775055 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.776504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.787155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 86/185] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.787836 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.821979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.864561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 100/186] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:43.865566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.926397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b933a-855f-47a2-9aa0-062c0bc4be4b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.963738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.970747 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.971897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.971897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.972273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] PATH_INFO: `/v3/projects/cbea9e5969fb40b2a1dec1c650327f90` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.973629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] RBAC: Authorizing `identity:get_project(project_id=cbea9e5969fb40b2a1dec1c650327f90)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.975237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.979410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 87/187] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/projects/cbea9e5969fb40b2a1dec1c650327f90 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:43.979552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.003108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345880-488b-4c9d-859b-48705f947cc6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.039546 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.040363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.040637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.040945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.042120 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.043576 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83fdb-dcd8-4de4-94df-40a05c86cb93 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.045246 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 101/188] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.046486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7a30-07fd-4e55-a1bc-87a251c1f063 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.046779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7a30-07fd-4e55-a1bc-87a251c1f063 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.047057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a7a30-07fd-4e55-a1bc-87a251c1f063 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.048305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 102/189] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:44.050302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a7a30-07fd-4e55-a1bc-87a251c1f063 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.080440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.087690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256397b-4ca5-45bc-a18d-331bad9bd8bd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.121679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.122551 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.122837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.123117 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.137081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.138543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.140511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 88/190] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.155018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a7a30-07fd-4e55-a1bc-87a251c1f063 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.189306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.190034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.190319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.190594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.201104 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:44.209268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:44.210371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 103/191] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:44.211733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.215008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.251510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c035cec-ec3c-4ad9-9495-fb19a0dffc66 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.286160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.286821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.287103 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.287382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.288232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=cbea9e5969fb40b2a1dec1c650327f90, user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:44.288548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.290044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14af5-7688-4905-8b99-3d976e1aac77 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.295964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 89/192] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/role_assignments?user.id=fe78eae3bd8c4ef2bc2b7bc1e0dfa808&scope.project.id=cbea9e5969fb40b2a1dec1c650327f90&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.297039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e400-e561-405a-bd33-048207f02003 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.297329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e400-e561-405a-bd33-048207f02003 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.297612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23e400-e561-405a-bd33-048207f02003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.315788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-de23e400-e561-405a-bd33-048207f02003 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:44.317094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-de23e400-e561-405a-bd33-048207f02003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:44.332613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.335374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30511b1-34b0-4100-adbf-de7cbdccda72 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.376563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.377290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.377580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.377861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.378594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.380271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.394301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 90/193] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:44.395115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23e400-e561-405a-bd33-048207f02003 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.416898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 104/194] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:44 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:44.422000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.508141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.561382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23e400-e561-405a-bd33-048207f02003 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.564085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2593d-2734-43d8-8db6-2da5b74a709f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.606804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.607470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.607745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.608023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.611646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.612335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.612625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.612941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.613775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:44.616435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.616435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.624196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 105/195] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:44.625145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.632571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.704986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.706748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.752186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbbfac-2c9f-4b5c-933f-8dacf36624ba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.779576 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.795915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.796569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.796738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.797050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.810159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:44.818503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:44.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:44.821286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 106/196] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:44.825452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.842661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 91/197] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:44.844141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.902979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.953350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e663c6-e33f-4db6-8382-47003402326a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.958829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca6531-8940-40ed-9af6-4feb0aa5ab9b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.995715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.996619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.996981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.997266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.998547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.000004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.000449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.001377 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.001849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.002052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 107/198] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.002544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.002941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.003823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:45.004320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.006233 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.018502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 92/199] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.019616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.063490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.127540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a621c-b3df-41d4-9b0f-5e1db14d4488 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.143913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a255-3b4c-42e0-ac7a-5f6adf92cee5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.157292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.179047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.179957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.180243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.180522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.184585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.185424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.186284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.186401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.186878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.187338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.192924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 108/200] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.193996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.267116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.268602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.315817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8bbe5-88c7-4a5f-8ad5-4f15f63a5216 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.335722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.355405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.356944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.357430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.357903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] PATH_INFO: `/v3/users/e31896239a994a55961ba0933907d8f2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.359348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] RBAC: Authorizing `identity:get_user(user_id=e31896239a994a55961ba0933907d8f2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.361139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.363156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 109/201] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/users/e31896239a994a55961ba0933907d8f2 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.365248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.373780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 93/202] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:45.378835 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.391651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.480690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad392-61a9-45a1-9bfa-bc911b52ebed None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.494158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f2e3-9500-4b4a-8648-abf131096887 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.516980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.517728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.517918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.518194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.533001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.534050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.534532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.535027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.536089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=256b7911e12842048a193e5662619853, user.id=4e95bd33a98f4121b3074b005bc26b78) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:45.536667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.538433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.553006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 110/203] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/role_assignments?user.id=4e95bd33a98f4121b3074b005bc26b78&scope.project.id=256b7911e12842048a193e5662619853&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.555100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.590089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.592088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.605270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.646565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.703176 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 94/204] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:45.716006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.778268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816ba0-643f-4feb-b654-ccdcaf013d0f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.841655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b7767-33b5-49c6-9b8e-64a9d4c491c3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:45.854339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:45.865574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.866829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.867359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.867831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.872662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.874395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.876979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 111/205] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.884778 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:45.884778 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:45.887400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:45.887400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:45.890594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:45.891022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:45.892154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:45.900876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 95/206] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:45.903885 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.022730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a851521-75b5-47c7-a062-8e9d6265849c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.074986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.075570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.075854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.076131 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.077015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390, user.id=e31896239a994a55961ba0933907d8f2) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:46.077332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.078783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4b2cd-46b3-47af-ad62-1ba2ecb19237 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.092454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 96/207] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/role_assignments?user.id=e31896239a994a55961ba0933907d8f2&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:46.100066 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af0fa-069b-4d50-8d9e-a9d8631ef21e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:46.135942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:46.136615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.136932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.137217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.138081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=256b7911e12842048a193e5662619853, user.id=4e95bd33a98f4121b3074b005bc26b78) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:46.138396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:46.139883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7daf6-4124-4fea-b8e7-5f6b7e153c0b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:46.146569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 112/208] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:45 2022] GET /identity/v3/role_assignments?user.id=4e95bd33a98f4121b3074b005bc26b78&scope.project.id=256b7911e12842048a193e5662619853&role.id=7f83d786d22243dab58a39a437993025 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:46.149494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:46.742751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f78-6509-4ef1-95b0-68451a20ff9d None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.743259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f78-6509-4ef1-95b0-68451a20ff9d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.743259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8f78-6509-4ef1-95b0-68451a20ff9d None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.744610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 97/209] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:46.745196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5dac-7396-4958-9ed3-fad155971530 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.745725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5dac-7396-4958-9ed3-fad155971530 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.746282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e5dac-7396-4958-9ed3-fad155971530 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.747872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 113/210] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:46.751099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.751605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.752082 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.753434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:46.753725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:46.754007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:46.770824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:46.771444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:46.772727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:46.773780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:46.816172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:46.853471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 98/211] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:46.861031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 114/212] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:46.878120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.879631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:46.995199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb810d-448e-4f22-b8d6-319ef06d22bd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.010265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.033992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e490de-91d5-40da-ac2a-ba851862ffde None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.048680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.050180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.051159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.051648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.066942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:47.077489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:47.078426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:47.079197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:47.079788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.080704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.081279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.081818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.087746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.087746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.087746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 99/214] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:47.088142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 115/214] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:47.088982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.094442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.140216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.223750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051532a-4d4a-45ce-88ac-7dcc286e6ae6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.238853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf7556-e9a8-42b3-b447-b2869463de24 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.269423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.270327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.270327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.272122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.272122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:47.272122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.273799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.287392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 100/215] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:47.292893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.298875 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.299853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.300377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.300762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.301613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.303161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.328980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 116/216] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:47 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:47.414863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3f1b-bb22-4de7-9b3f-394dca477956 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.416700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.467413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.468524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.468934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.469221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] PATH_INFO: `/v3/users/b863686b3e964e27ba781c36aa7f863a` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.493707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] RBAC: Authorizing `identity:get_user(user_id=b863686b3e964e27ba781c36aa7f863a)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.496090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.499227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 101/217] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:47 2022] GET /identity/v3/users/b863686b3e964e27ba781c36aa7f863a => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:47.504548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:47.543098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.628355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f7bd1-e35a-4eba-b7a0-7fd93398e512 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:47.674272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:47.674948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:47.675239 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:47.675521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:47.755201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:47.756677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0d0a8-9361-422e-ac5b-8e56d4cdc9a2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:47.788284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:47.867671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 117/218] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:47.873386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.021529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ab1b4-06f0-4761-9512-f91ecdef4f83 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:48.082072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:48.083330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.083813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.084286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.090070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:48.091812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439c2cd-75ae-49df-8db3-07914dcac5e0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:48.092328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b348f-ddfb-46af-b0a2-db03734909f8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.092624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b348f-ddfb-46af-b0a2-db03734909f8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.092929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b348f-ddfb-46af-b0a2-db03734909f8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.094325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 118/219] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:48.094950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 102/220] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:47 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:48.100634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b348f-ddfb-46af-b0a2-db03734909f8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.102531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.103066 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.103642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.123867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:48.125466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:48.155385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:48.253180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 103/221] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:48.273906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b348f-ddfb-46af-b0a2-db03734909f8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:48.300114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.305427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:48.321997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:48.322867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.323170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.323456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.324394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=256b7911e12842048a193e5662619853, user.id=b863686b3e964e27ba781c36aa7f863a) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:48.324713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:48.326389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:48.339773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 119/222] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:48 2022] GET /identity/v3/role_assignments?user.id=b863686b3e964e27ba781c36aa7f863a&scope.project.id=256b7911e12842048a193e5662619853&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:48.454634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb751df5-58e2-4ede-b730-f24d174b1f9b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:48.519058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:48.519894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.520185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.520471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.546475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5e27faa3-c0bf-4644-8200-5459689da9dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:48.556249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:48.557408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:48.558373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 104/223] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:48.565740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.622485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda611c1-adb4-4fc1-9724-009d2bcaaf1b None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.622780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda611c1-adb4-4fc1-9724-009d2bcaaf1b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.623067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda611c1-adb4-4fc1-9724-009d2bcaaf1b None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.624460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 105/224] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:25:48.636293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.636293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.636293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.658991 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:48.661018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:48.677510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:48.734853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d41baa-fca3-44ef-8c89-dc061d34f1bc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:48.778488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 106/225] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:48.802491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:48.803186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:48.803479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:48.803762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:48.804729 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:48.805274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:48.807805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:48.821131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 120/226] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:48.826512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.830430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:48.945832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.002952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b269bfe-b0c2-4729-882b-419a9d997d36 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.038238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208311d-b0fa-45b1-aabb-32065670e385 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.041784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.042979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.043093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.043374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.054705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:49.063019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:49.063893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:49.064674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 107/227] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:49.070970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.079968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.083004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.083293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.083690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.084169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.086464 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.088138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.090331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 121/228] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:48 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:49.095975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.204140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b126-374a-4c58-bcd3-8633e37dc58e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.216876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46906959-a4e9-4d8a-8d81-0f10dd080838 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.228119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.244582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.245870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.246354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.246829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.248301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.250040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.252265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 122/229] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:49.258756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.298157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.298850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.299133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.299406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.300181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:49.300489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.302027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.324465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 108/230] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:49.329367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.372478 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22620a-2e1f-4923-9d5b-72eafb34b108 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.409437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.410707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.411188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.411657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/users/4e95bd33a98f4121b3074b005bc26b78/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.414577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, user_id=4e95bd33a98f4121b3074b005bc26b78, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.416254 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.438426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 123/231] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:49 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/users/4e95bd33a98f4121b3074b005bc26b78/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:49.484899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.526076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a57d-c00e-48f3-93ff-f57c6f5f40b8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.565069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.565993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.566282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.566613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.567965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.569466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.571484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 109/232] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:49.577063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.659412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.739708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d8179-a8e1-427c-8172-d738d4101191 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.782814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.783621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.783902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.784185 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.785770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.787241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed63792-8838-4688-9e3e-7fe1d21cb19c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.790015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 124/233] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:49.795533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.921341 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ae1c-51e9-4351-9c5d-62d33596235e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.962876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.962876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.962876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.962876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/users/4e95bd33a98f4121b3074b005bc26b78/roles/7f83d786d22243dab58a39a437993025` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.963603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, user_id=4e95bd33a98f4121b3074b005bc26b78, role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.964312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f670f-c46f-4004-9ec8-66422a291db6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.975666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:49.984779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 110/234] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:49 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/users/4e95bd33a98f4121b3074b005bc26b78/roles/7f83d786d22243dab58a39a437993025 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:50.029131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fe70-0ab3-4e6d-a46b-4ceb994855d9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.029798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fe70-0ab3-4e6d-a46b-4ceb994855d9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.029798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fe70-0ab3-4e6d-a46b-4ceb994855d9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.031124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 125/235] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:50.037621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.038102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.038102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.057674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:50.058963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:50.140336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 111/236] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:50.177118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68fe70-0ab3-4e6d-a46b-4ceb994855d9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.311151 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68fe70-0ab3-4e6d-a46b-4ceb994855d9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.333733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.361512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.362555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.362981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.363436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.381852 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:50.389812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:50.390697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:50.391892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 126/237] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:50.398293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.583827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d273d-0fdd-4e1b-bf06-7c960553554f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.623249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:50.632178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.632875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.633174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.637237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.638030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:50.638345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.639719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b264a-f566-420e-b4dd-3523a6ae54ca None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.649851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 112/238] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:50.655693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.700717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3280e-0d25-4d49-8b7c-e9045828a7fc None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.701059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3280e-0d25-4d49-8b7c-e9045828a7fc None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.701325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3280e-0d25-4d49-8b7c-e9045828a7fc None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.702872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 113/239] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:50.708214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.708502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.708779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.740659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:50.742434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:50.827086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845861a5-d677-4434-a3c0-7242072faf5a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:50.863576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 114/240] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:50.863742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:50.864486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:50.864756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:50.865057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] PATH_INFO: `/v3/users/ae25d333d5ff496d9492a73adb710e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:50.879173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] RBAC: Authorizing `identity:get_user(user_id=ae25d333d5ff496d9492a73adb710e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:50.880712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:50.882992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 127/241] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/users/ae25d333d5ff496d9492a73adb710e58 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:50.888504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.897064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:50.933854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.001188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5d2a-cffe-4c94-9421-360c50705b38 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.005828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19656b5-0952-4182-8c0e-8ba2755f144b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.028175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.037075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.037889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.038181 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.038494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.039703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.041400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44045dd5-726a-4bcf-8966-30c0480d1382 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.043950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 128/242] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:51.045273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d6bce-256f-4215-ab0d-5a990c6ca9ed None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.045561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d6bce-256f-4215-ab0d-5a990c6ca9ed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.045843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d6bce-256f-4215-ab0d-5a990c6ca9ed None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.047096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 129/243] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:51.049063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.050034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.050311 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.051946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d6bce-256f-4215-ab0d-5a990c6ca9ed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.125504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.126917 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.159909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d6bce-256f-4215-ab0d-5a990c6ca9ed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.189218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.201524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.202365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.202677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.202957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.203716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.205646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa4c54-6e18-4822-a7e0-9770046fdc17 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.231636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 130/244] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:51 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:51.233085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.233384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.233695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.264596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:51.265845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:51.269761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 115/245] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:51.277353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.305705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.391560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb150c-f1f0-4b13-9782-c02b46f79315 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.431027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.431895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.432178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.432450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.435141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.436580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.438645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 116/246] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:51.444044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.477072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 131/247] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:51.508556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.580546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.597195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09fd3-079d-4ff2-ba32-66b8af5f95d6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.627520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:51.642748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7659-21a4-41ad-a43d-39f78b4d2d18 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.655224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.655675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.656161 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.657340 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, scope.project.id=256b7911e12842048a193e5662619853, user.id=ae25d333d5ff496d9492a73adb710e58) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:51.657894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.659683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.669454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 117/248] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/role_assignments?user.id=ae25d333d5ff496d9492a73adb710e58&scope.project.id=256b7911e12842048a193e5662619853&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:51.689039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.689864 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.690152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.690435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.702850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:51.710962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:51.711920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:51.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 132/249] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:51.718538 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:51.856414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20d7e-227d-42bb-aa7f-ab4e9587210b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:51.894187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:51.894786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:51.895069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:51.895341 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:51.896283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:51.896588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:51.898041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:51.909295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 118/250] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:51.915008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.046473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965103a0-0b7b-461c-a896-e8fafd264a9c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.087414 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.088300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.088581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.088876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] PATH_INFO: `/v3/users/b863686b3e964e27ba781c36aa7f863a` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.093196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] RBAC: Authorizing `identity:get_user(user_id=b863686b3e964e27ba781c36aa7f863a)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.094682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e539d-b17a-4b32-8468-25f79e87ec00 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.102553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 133/251] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:51 2022] GET /identity/v3/users/b863686b3e964e27ba781c36aa7f863a => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.108008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.127980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.154252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd84-b989-4c74-a32b-2436903f0cc2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.154555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd84-b989-4c74-a32b-2436903f0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.154753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd84-b989-4c74-a32b-2436903f0cc2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.156447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 134/252] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:52.166106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.166106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.166106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.190746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:52.191973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:52.226319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.264088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20b38b-06c4-4bc6-bc0c-ca538c4ac697 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.330868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.331754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.332042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.332321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.334535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 135/253] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:52.336698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.338189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.340166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 119/254] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:52.345680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.391262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.586505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a492d-c600-4b2c-a69e-945d6b658d8c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.589974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.648126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.649206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.649503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.649782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/users/b863686b3e964e27ba781c36aa7f863a/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.655076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182ff2-3b66-414d-9aaf-858f57cc22bc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.658187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, user_id=b863686b3e964e27ba781c36aa7f863a, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.659663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.683172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 136/255] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:52 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/users/b863686b3e964e27ba781c36aa7f863a/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:52.752076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.752808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.753119 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.753397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.771311 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-00f0be88-557a-4a85-9a3e-2ebcaabf5aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:52.780192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:52.781194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:25:52.781975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:52.784953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 120/256] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:52.787280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.811194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.831001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80cf0-d501-43c8-8a18-fedbe321df4a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.831634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80cf0-d501-43c8-8a18-fedbe321df4a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.832118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b80cf0-d501-43c8-8a18-fedbe321df4a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.834251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 121/257] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:52.842812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.843441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.843876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.884201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:52.887223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:52.994093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a342b-b9cc-4bc0-8411-d4ac78e45840 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.034814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.035426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.035973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.036253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.037367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:53.037677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.039641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.048928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 137/258] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.051444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 122/259] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:25:53.055117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.090269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.145161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.203235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01008f3f-2dd7-42c0-90a5-55cea6238d80 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.234495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.275090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.275999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.276291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.276573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.278662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.284351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.286321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 138/260] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:53.295840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa6ca9-e0cc-4df4-ba4c-fef0873cf2e4 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.310386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.400110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.401034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.401318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.401603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.431916 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:53.440225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:53.441168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:25:53.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:53.449815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 123/261] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:53.455860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.547425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee773b-fb1c-4643-8b91-ae2ea552fe19 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.617532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.618195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.618482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.618761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.637182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.744884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.746727 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.799023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20fa3-5190-472f-9b57-54013cda5e93 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:53.877956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:53.890884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:53.891879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:53.892463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:53.892957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:53.893922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:53.894426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:53.896829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:53.912076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 124/262] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:53.919343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:53.961164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 139/263] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:25:53.963029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.047398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.143294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475d15c-7dba-4996-8973-5b13295360ef None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.191139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb22529-a952-4691-8d91-1dbe7005e831 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.234625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.235524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.235812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.236170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] PATH_INFO: `/v3/users/4e95bd33a98f4121b3074b005bc26b78` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.237461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] RBAC: Authorizing `identity:get_user(user_id=4e95bd33a98f4121b3074b005bc26b78)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.239378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.247283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 125/264] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/users/4e95bd33a98f4121b3074b005bc26b78 => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:54.253489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.266769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.267970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.268538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.268820 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.273803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.275274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.279509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 140/265] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:53 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:54.285647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.372108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.421797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4db53-2cfd-4879-b49e-f8453907250a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.468617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.469608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.470656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.471084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.529054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f5c9-b756-435c-8c5d-11557bd0ad20 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.540053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.593525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.595009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.608755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.609740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.610027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.610307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.611167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=256b7911e12842048a193e5662619853, user.id=4e95bd33a98f4121b3074b005bc26b78) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:54.611544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.613026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad4f1-c69f-4969-a847-f2d7f7b49245 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.624536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 141/266] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/role_assignments?user.id=4e95bd33a98f4121b3074b005bc26b78&scope.project.id=256b7911e12842048a193e5662619853&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:54.625904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00bcda-acda-49f4-aec2-a025ca214c75 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.626195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00bcda-acda-49f4-aec2-a025ca214c75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.626479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00bcda-acda-49f4-aec2-a025ca214c75 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.628021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 142/267] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:54.637758 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb6be-fdb5-4622-94d3-4b3ff84795e4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.638068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb6be-fdb5-4622-94d3-4b3ff84795e4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.638327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb6be-fdb5-4622-94d3-4b3ff84795e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.677536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bcfeb6be-fdb5-4622-94d3-4b3ff84795e4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:54.678736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bcfeb6be-fdb5-4622-94d3-4b3ff84795e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:54.727374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.800258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 143/268] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:54.802009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a34c-dbdf-48a7-b872-bb4f9594cfc7 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.802303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a34c-dbdf-48a7-b872-bb4f9594cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.802584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8a34c-dbdf-48a7-b872-bb4f9594cfc7 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.804042 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 144/269] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:54.811227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.811581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.811873 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.846023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:54.847277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:54.848502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 126/270] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:54.855760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.930974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 145/271] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:54.931779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.969520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.026777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d7776-afef-4b4b-960b-41131a210d07 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.055296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749cb3b-e3b2-47f3-95ae-77b9d866222d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.063434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.064303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.064588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.064902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.066120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.067569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4417116-e42f-45f9-bf6b-63949413e18a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.073367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 127/272] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.073367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39693-4536-4798-97fa-fd11e361d0f1 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.073367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39693-4536-4798-97fa-fd11e361d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.073367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39693-4536-4798-97fa-fd11e361d0f1 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.073367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 128/273] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:55.073758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39693-4536-4798-97fa-fd11e361d0f1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.102723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.103639 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.104041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.104322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.106306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.119018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:55.127383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:55.131534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 146/274] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:55.132982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.188987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39693-4536-4798-97fa-fd11e361d0f1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.223283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.224080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.224392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.224647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.235313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:55.238662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-8f7d0dbd-c865-4770-8924-a093837e41d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:55.244076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:55.245020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:55.245788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 129/275] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:55.246634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.246980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.247189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.254463 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a450d-2f06-44e8-ac05-ddc5a3fe09d4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.265589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:55.266760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:55.292245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.293253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.293724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.294076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.294932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=256b7911e12842048a193e5662619853, user.id=4e95bd33a98f4121b3074b005bc26b78) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:55.295250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.296715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.303594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 147/276] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/role_assignments?user.id=4e95bd33a98f4121b3074b005bc26b78&scope.project.id=256b7911e12842048a193e5662619853&role.id=7f83d786d22243dab58a39a437993025 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.305203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.352947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 130/277] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:55.352947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.370590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.460504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4a746-2f0e-4273-8e70-24367f1cdffc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.462396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60e1a-2aac-4a43-b934-3f2cd8e4b98a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.505617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.506305 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.506569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.506878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.507643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:55.507944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.509509 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.510372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.511046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.511881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.512902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:55.513421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.515540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.523614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 131/278] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.524614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.527007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 148/279] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.529287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.554417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.635181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.658615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced76095-e3a8-4677-8552-1e852075e810 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.666213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7788-0dd1-48a3-a110-a7f771ec3405 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.698234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.699034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.699326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.699592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.700748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.702223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.702714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.703591 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.703851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 132/280] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.708440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.708440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] PATH_INFO: `/v3/users/f4530cf750664109b2757539c5e251c2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.708613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.728123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] RBAC: Authorizing `identity:get_user(user_id=f4530cf750664109b2757539c5e251c2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.729652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.731420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 149/281] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/users/f4530cf750664109b2757539c5e251c2 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.733668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.818475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c3a0c-3463-42ba-986a-f322748c770a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.821656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.848448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac59e-62b2-4bc0-a743-bf56f125f11c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.853268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.854147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.854431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.854708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] PATH_INFO: `/v3/users/ae25d333d5ff496d9492a73adb710e58` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.855904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] RBAC: Authorizing `identity:get_user(user_id=ae25d333d5ff496d9492a73adb710e58)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.857777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.860105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 133/282] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/users/ae25d333d5ff496d9492a73adb710e58 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:55.861079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.882907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.889762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.890444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.890729 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.891007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.891724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.893191 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b7a8-05c5-422c-9795-8323723c585e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.912741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 150/283] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:25:55 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:55.914773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5611-70b0-47b9-ba6d-3c7a6ed63f0d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.915321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5611-70b0-47b9-ba6d-3c7a6ed63f0d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.915321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5611-70b0-47b9-ba6d-3c7a6ed63f0d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.916815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 151/284] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:55.922617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5611-70b0-47b9-ba6d-3c7a6ed63f0d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.985366 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8f18f-56cd-4e47-8d55-aec2fb2b275a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.035467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.036290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.036580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.036885 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.037762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, user.id=f4530cf750664109b2757539c5e251c2, scope.system=all) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:56.038113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.040342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94b29-7967-48e5-a2b9-db756d642e52 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.056895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 134/285] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/role_assignments?user.id=f4530cf750664109b2757539c5e251c2&scope.system=all&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:56.056895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.056895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.056895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.073494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5611-70b0-47b9-ba6d-3c7a6ed63f0d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.075438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.076685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.112784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.122993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.124058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.124383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.124666 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.131401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.131401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.132536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 152/286] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:56.137902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.180297 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 135/287] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:56.203149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.223210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.275216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83218-eb8f-4495-867d-3fd7b2ef7c92 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.336261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.337842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.338238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.338620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/users/ae25d333d5ff496d9492a73adb710e58/roles/c69e3298ff7145e5b2478a6f5635eb57` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.341140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333c7b-0f37-4d9b-9284-0b698b71b0a1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.341599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, user_id=ae25d333d5ff496d9492a73adb710e58, role_id=c69e3298ff7145e5b2478a6f5635eb57)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.343444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.363863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 153/288] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:25:56 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/users/ae25d333d5ff496d9492a73adb710e58/roles/c69e3298ff7145e5b2478a6f5635eb57 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:56.388412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.389333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.389603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.389884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.406758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:56.416756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:56.417944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:56.418927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 136/289] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:56.426098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.505017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.555880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f8ebb-6fb3-46c3-a817-7a8c8ca23d69 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.592959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.593630 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.593915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.594200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.595026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:56.595344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.596722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.606258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 154/290] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:56.611863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.714472 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.755608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a54c0-8bdf-4c60-b07e-268bc046e078 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.809667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.810640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.811021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.811413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] PATH_INFO: `/v3/users/b863686b3e964e27ba781c36aa7f863a` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.812807 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] RBAC: Authorizing `identity:get_user(user_id=b863686b3e964e27ba781c36aa7f863a)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.814396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.816166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 137/291] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/users/b863686b3e964e27ba781c36aa7f863a => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:56.822177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.991100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874029f-8a71-4c6f-b9ae-4b65f9e84784 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.020177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.040363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.041056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.041346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.041628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.158962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.160567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.289213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 155/292] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:25:57.294391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.458087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf007-c7e5-4928-8b98-a296aaef041d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.517736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.518609 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.518892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.519169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.525712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.527199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac07872-feec-4308-9ec8-2656c48bed07 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.529736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 138/293] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:57.537124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.580091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.722925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe966d7-76fa-45aa-b194-3f1488a5c0a0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.784504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.785538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.786024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.786522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.787580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=256b7911e12842048a193e5662619853, user.id=b863686b3e964e27ba781c36aa7f863a) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:57.788130 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.789785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcaeda-a6e9-4a89-844c-15ef1a8369f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.798819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 156/294] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/role_assignments?user.id=b863686b3e964e27ba781c36aa7f863a&scope.project.id=256b7911e12842048a193e5662619853&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:58.544108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e16c-b829-44f1-9f92-5d35f4b70d38 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.544610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e16c-b829-44f1-9f92-5d35f4b70d38 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.544684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e16c-b829-44f1-9f92-5d35f4b70d38 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.546259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 139/295] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:58.551966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367bcf-8cce-4a9d-a5ec-c3ed6ace92cc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.552432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367bcf-8cce-4a9d-a5ec-c3ed6ace92cc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.552533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7367bcf-8cce-4a9d-a5ec-c3ed6ace92cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.570789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b7367bcf-8cce-4a9d-a5ec-c3ed6ace92cc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:58.572053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b7367bcf-8cce-4a9d-a5ec-c3ed6ace92cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:58.647637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 157/296] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:58.656756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3a11-cf9f-4847-8710-c0b8d17f8a0f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.657107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3a11-cf9f-4847-8710-c0b8d17f8a0f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.657360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3a11-cf9f-4847-8710-c0b8d17f8a0f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.658894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 140/297] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:58.665218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.665784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.666285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.679217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a3a11-cf9f-4847-8710-c0b8d17f8a0f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:58.685643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:58.686848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:58.689214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.698203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.760280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 158/298] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:58.783093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:58.801405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a3a11-cf9f-4847-8710-c0b8d17f8a0f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:58.849314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.850296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.850964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.851381 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.865346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-cb1f4f4f-b4c3-49a7-9ad0-1250d4d356f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:58.876428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:58.877574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 141/299] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:58.884222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2ece-6d74-4aeb-9aa9-475b41da61bb None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.884971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2ece-6d74-4aeb-9aa9-475b41da61bb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.884971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2ece-6d74-4aeb-9aa9-475b41da61bb None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.884971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 142/300] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:58.887074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd2ece-6d74-4aeb-9aa9-475b41da61bb None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:58.893689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515460b6-a09b-4ccb-8c7b-c70cc473bfad None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:58.933426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:58.934234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.934521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.934801 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.947883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-676c3cd6-04d7-4528-ba47-86c100664573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:58.955728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:58.956735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:25:58.957701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 159/301] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:25:58.960098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:58.960391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:58.960672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:58.962428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.967959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:58.980773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:58.982009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:59.000965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd2ece-6d74-4aeb-9aa9-475b41da61bb None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.035587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.036176 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.036463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.036765 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.037543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:59.037892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.039284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb514-2b11-4d28-99f8-b2eb925038af None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.047627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 143/302] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.048963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6144fc-3fd7-431d-b5bc-652552ae23c9 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.049228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6144fc-3fd7-431d-b5bc-652552ae23c9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.049513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6144fc-3fd7-431d-b5bc-652552ae23c9 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.050210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 160/303] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:59.051054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.057743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 144/304] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:25:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:25:59.058764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6144fc-3fd7-431d-b5bc-652552ae23c9 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.152862 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3575ddd-a825-4a45-80d0-1a54402c256c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.188268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6144fc-3fd7-431d-b5bc-652552ae23c9 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.197269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.197976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.198260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.198536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.199302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:59.199608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.201016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc9a60-117b-48f4-b1ce-d44e7944ffb5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.202483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.210829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 161/305] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.212372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.212664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.212965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.229757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:59.230979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:59.237072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.244238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.245148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.245435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.245714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] PATH_INFO: `/v3/users/2eb857d26f0b48168868be8d3207a488` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.259412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] RBAC: Authorizing `identity:get_user(user_id=2eb857d26f0b48168868be8d3207a488)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.260941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.262685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 145/306] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/users/2eb857d26f0b48168868be8d3207a488 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.263539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.303026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 162/307] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:25:59.304715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.368737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6ca50-a6f4-4159-8888-1f58cea0005a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.404248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdde29-d46a-4e97-b730-b7231bf037cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.411285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.412090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.412376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.412656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.425517 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:25:59.431829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:25:59.434178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:25:59.435105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:25:59.435884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 146/308] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:25:59.436549 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.442751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.443929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.444216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] PATH_INFO: `/v3/users/f4530cf750664109b2757539c5e251c2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.445489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] RBAC: Authorizing `identity:get_user(user_id=f4530cf750664109b2757539c5e251c2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.446958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.448646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 163/309] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/users/f4530cf750664109b2757539c5e251c2 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.449440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.490613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.546865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c804b-b7ea-444e-8ed4-2ff468a52d5f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.566606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f224a-7604-4963-a2bd-7e877df78a63 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.582035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.582885 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.583163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.583436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.584276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, user.id=2eb857d26f0b48168868be8d3207a488, scope.system=all) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:59.584583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.586736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.592293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 147/310] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/role_assignments?user.id=2eb857d26f0b48168868be8d3207a488&scope.system=all&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.593144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.615807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.616687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.617012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.617294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.618645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.620163 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.626799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 164/311] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.626799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.702616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.721771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b038-140c-4571-9e7e-3ddf951ebb57 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.740387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:59.761047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416d258-6fd6-4d44-8bbd-d6c110741fd8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.765946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.766631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.766923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.767203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.767976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:59.768288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.769731 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.783693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 148/312] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:59.786478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.805517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:59.806394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:59.806683 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:59.806958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] PATH_INFO: `/v3/system/users/f4530cf750664109b2757539c5e251c2/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:59.808501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f4530cf750664109b2757539c5e251c2, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:59.809907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:59.829588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 165/313] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Jul 11 14:25:59 2022] PUT /identity/v3/system/users/f4530cf750664109b2757539c5e251c2/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:59.829588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:59.957239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6641-768b-41d4-be1c-54c2422a8bc7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:59.967980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736624e-d627-4ac2-93b0-676aa43144c8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.004358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.008705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.009819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.010265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.011120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] PATH_INFO: `/v3/groups` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.012220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.013714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.015911 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.016877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.017174 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.017643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] PATH_INFO: `/v3/users/ae25d333d5ff496d9492a73adb710e58` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.018881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] RBAC: Authorizing `identity:get_user(user_id=ae25d333d5ff496d9492a73adb710e58)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.020442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.022977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 166/314] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:25:59 2022] GET /identity/v3/users/ae25d333d5ff496d9492a73adb710e58 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.029697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.031974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 149/315] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Jul 11 14:25:59 2022] POST /identity/v3/groups => generated 229 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:00.170328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2777b-14f8-418a-a510-c09fb6b30133 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.212129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.213469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.213760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.214046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.280411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.288562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.290077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.395249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 167/316] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:00.401030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.437208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.519450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369e9ba-b57e-4307-8335-c47d412f2e2c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.556503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.557406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.557691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.557967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.559206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.560659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d74e51-95e5-4bf9-90b7-6d6bd37ff3f3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.562494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 150/317] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:00.568518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.671331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.678339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89c98-97f7-47e0-9bbd-3e71e48f662a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.715560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.716133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.716419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.716695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.717569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, scope.project.id=256b7911e12842048a193e5662619853, user.id=ae25d333d5ff496d9492a73adb710e58) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:00.717882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.719325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ec541-aec5-41db-a487-9eefd52a5b09 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.725694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 168/318] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/role_assignments?user.id=ae25d333d5ff496d9492a73adb710e58&scope.project.id=256b7911e12842048a193e5662619853&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:01.699166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde8e4-d712-4df1-90ab-54c15499ecea None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.699705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde8e4-d712-4df1-90ab-54c15499ecea None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.699705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde8e4-d712-4df1-90ab-54c15499ecea None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.701511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 151/319] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:01.706847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111a0c-ffbc-49c4-8038-4fc3d0c048b4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.707296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111a0c-ffbc-49c4-8038-4fc3d0c048b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.707480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111a0c-ffbc-49c4-8038-4fc3d0c048b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.725589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6c111a0c-ffbc-49c4-8038-4fc3d0c048b4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:01.726786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6c111a0c-ffbc-49c4-8038-4fc3d0c048b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:01.796986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 169/320] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:01.818705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde8e4-d712-4df1-90ab-54c15499ecea None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.926993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde8e4-d712-4df1-90ab-54c15499ecea None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.928621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.966153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.966951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.967230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.967502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.974812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b0b3-b1ee-4b23-a855-1181dfb19b13 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.975106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b0b3-b1ee-4b23-a855-1181dfb19b13 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.975458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9b0b3-b1ee-4b23-a855-1181dfb19b13 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.977385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 170/321] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:01.979056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:01.982444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.982734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.983016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:01.987064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:01.987900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:01.988763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 152/322] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:01.993961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.002251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:02.003884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:02.081111 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 171/323] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:02.102242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.108242 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1ec5-d604-4771-afbb-913d4ed77650 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.120433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.143984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e05513-da60-4897-811a-1864ac04804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.144669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e05513-da60-4897-811a-1864ac04804c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.145026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e05513-da60-4897-811a-1864ac04804c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.145309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e05513-da60-4897-811a-1864ac04804c None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.146083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e05513-da60-4897-811a-1864ac04804c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:02.146396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e05513-da60-4897-811a-1864ac04804c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.148348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e05513-da60-4897-811a-1864ac04804c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.157658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 153/324] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:02.163185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e05513-da60-4897-811a-1864ac04804c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.198899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.222777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9e69a-ac0f-42cc-b3fe-398d8a03ca31 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.256112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.257464 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.257754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.258031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.268148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0c96275c-03f2-4778-8680-6b6334f10a0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:02.276581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:02.277578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:02.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 172/325] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:02.279295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cbb5-7848-4858-8733-5652dacbeab5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.279610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cbb5-7848-4858-8733-5652dacbeab5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.279893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cbb5-7848-4858-8733-5652dacbeab5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.281311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 173/326] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:02.282513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e05513-da60-4897-811a-1864ac04804c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.283891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270cbb5-7848-4858-8733-5652dacbeab5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.317229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.318124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.318414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.318695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] PATH_INFO: `/v3/users/2eb857d26f0b48168868be8d3207a488` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.320539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] RBAC: Authorizing `identity:get_user(user_id=2eb857d26f0b48168868be8d3207a488)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.322020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904714eb-9791-42ef-b909-0a73ca3efc36 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.323693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 154/327] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/users/2eb857d26f0b48168868be8d3207a488 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:02.324878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.325166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.325447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.342577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:02.343698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:02.364924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.388171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270cbb5-7848-4858-8733-5652dacbeab5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.414880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 155/328] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:02.415530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.424306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.425035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.425316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.425568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.426319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] RBAC: Adding query filter params (name=member) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:02.426625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.428028 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.440213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 174/329] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.440213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.444449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.522266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd589c14-e001-4f98-b625-52dc95cdb279 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.542194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f16-95c0-4b4a-914f-b999a73fa08d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.556533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.557424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.557708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.557984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] PATH_INFO: `/v3/system/users/2eb857d26f0b48168868be8d3207a488/roles/c69e3298ff7145e5b2478a6f5635eb57` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.559459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2eb857d26f0b48168868be8d3207a488, role_id=c69e3298ff7145e5b2478a6f5635eb57)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.560821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.568965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 156/330] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Jul 11 14:26:02 2022] PUT /identity/v3/system/users/2eb857d26f0b48168868be8d3207a488/roles/c69e3298ff7145e5b2478a6f5635eb57 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:02.570299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.576869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.577696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.577978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.578249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.579512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.581103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.582832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 175/331] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.588625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.601126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.678845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:02.698175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a34a06-dadc-45ad-9edd-4e4c1d10b709 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.714623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e0fe-8276-45a0-b344-bfb92650598d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.742993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.744067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.744351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.744623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] PATH_INFO: `/v3/users/f4530cf750664109b2757539c5e251c2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.745929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] RBAC: Authorizing `identity:get_user(user_id=f4530cf750664109b2757539c5e251c2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.747391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.749263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 157/332] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/users/f4530cf750664109b2757539c5e251c2 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:02.754630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:02.759555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.760318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.760610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.760915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] PATH_INFO: `/v3/groups` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.761651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.763113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963947db-f9ee-48f7-b3ff-b5f91a286c09 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.780648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 176/333] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Jul 11 14:26:02 2022] POST /identity/v3/groups => generated 226 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:26:02.876682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7b77-faff-4fed-8444-32b99da701cf None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.916567 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.917284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.917577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.917854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.918733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] RBAC: Adding query filter params (role.id=ad3f7de6169e46818a2e6e66d91aacc2, user.id=f4530cf750664109b2757539c5e251c2, scope.system=all) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:02.919048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.920519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373ebe0-f0a5-47ca-8c75-b890e99e3570 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.934142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 158/334] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:02 2022] GET /identity/v3/role_assignments?user.id=f4530cf750664109b2757539c5e251c2&scope.system=all&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:05.217267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795817c-0bb4-4a20-80b9-4449189c797e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.217775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795817c-0bb4-4a20-80b9-4449189c797e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.217881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795817c-0bb4-4a20-80b9-4449189c797e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.219500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 177/335] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:05.224546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.225530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.225726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.249985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:05.251211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:05.259851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.331037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 159/336] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:05.370084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795817c-0bb4-4a20-80b9-4449189c797e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.450379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.502505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795817c-0bb4-4a20-80b9-4449189c797e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.545840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.546650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.546939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.547218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.560554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e8fbab02-e391-414a-84f2-4ee46729aa46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:05.568562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:05.569647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:05.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 178/337] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:05.575880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.658608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569af5-8828-4b7a-a7d8-05e728dc8ff5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.658923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569af5-8828-4b7a-a7d8-05e728dc8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.659177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7569af5-8828-4b7a-a7d8-05e728dc8ff5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.660567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 179/338] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:05.679290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4324-7705-45b2-a385-8f2b225f0d68 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.679933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4324-7705-45b2-a385-8f2b225f0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.680413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4324-7705-45b2-a385-8f2b225f0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.708880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a3fa1-4a5e-4097-8a81-8a5184f3d9c5 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:05.717916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-657d4324-7705-45b2-a385-8f2b225f0d68 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:05.719470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-657d4324-7705-45b2-a385-8f2b225f0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:05.745433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:05.746035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.746496 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.746786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.747674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:05.747988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:05.749395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:05.760555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 160/339] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:05.774470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:05.782070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:05.877217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 180/340] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:05.878560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c32c-8db5-4578-a074-fa59e3da49f1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.878847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c32c-8db5-4578-a074-fa59e3da49f1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.879121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c32c-8db5-4578-a074-fa59e3da49f1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.880531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 181/341] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:05.897138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecaf4-f425-4a50-b6d8-960f7529605f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:05.897440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecaf4-f425-4a50-b6d8-960f7529605f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:05.897695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecaf4-f425-4a50-b6d8-960f7529605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:05.928715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-55eecaf4-f425-4a50-b6d8-960f7529605f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:05.931141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-55eecaf4-f425-4a50-b6d8-960f7529605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:06.004040 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faea20-9d82-46bf-a60a-3837ae48d2bb None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.056207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.061913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.062802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.063090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.063370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] PATH_INFO: `/v3/users/2eb857d26f0b48168868be8d3207a488` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.065568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] RBAC: Authorizing `identity:get_user(user_id=2eb857d26f0b48168868be8d3207a488)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.067058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.069369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 161/342] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:26:05 2022] GET /identity/v3/users/2eb857d26f0b48168868be8d3207a488 => generated 293 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.072611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 182/343] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:06.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.074435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7506b5-13e7-452d-9ea1-9e2501c5faf5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.074911 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7506b5-13e7-452d-9ea1-9e2501c5faf5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.075375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7506b5-13e7-452d-9ea1-9e2501c5faf5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.077424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 183/344] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:06.089020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7506b5-13e7-452d-9ea1-9e2501c5faf5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.180979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.217769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ece404-1edd-4f21-9098-398bab54d1ef None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.228045 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7506b5-13e7-452d-9ea1-9e2501c5faf5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.269697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.270424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.270703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.270972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.279797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.280465 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.280750 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.281065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.281917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] RBAC: Adding query filter params (role.id=c69e3298ff7145e5b2478a6f5635eb57, user.id=2eb857d26f0b48168868be8d3207a488, scope.system=all) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:06.282230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.283654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.287524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e43bbdac-e23f-40e3-ab57-5a2a94847b91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:06.295921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:06.297044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:06.298026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:06.300244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 162/345] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:06.301911 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98dfa3-07e3-484f-b087-73525899a019 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.302351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98dfa3-07e3-484f-b087-73525899a019 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.302796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98dfa3-07e3-484f-b087-73525899a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.308737 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 184/346] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/role_assignments?user.id=2eb857d26f0b48168868be8d3207a488&scope.system=all&role.id=c69e3298ff7145e5b2478a6f5635eb57 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.310944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.328504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-1e98dfa3-07e3-484f-b087-73525899a019 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:06.330057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1e98dfa3-07e3-484f-b087-73525899a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:06.396243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.450239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 163/347] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:06.451831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37900-4c78-43bc-b57d-ab88eea8eb99 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.452260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37900-4c78-43bc-b57d-ab88eea8eb99 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.452673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37900-4c78-43bc-b57d-ab88eea8eb99 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.460247 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 164/348] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:06.461299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37900-4c78-43bc-b57d-ab88eea8eb99 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.483908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d258c4e-21cd-4c82-96f7-099bb0a7a4af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.530032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.531218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.531697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.532276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.545755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:06.548405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-28f2bbd6-9183-451d-b839-227eaa632964 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:06.554769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:06.555676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:06.556651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 185/349] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:06.557903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.557903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.557903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.583475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:06.584731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:06.614496 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37900-4c78-43bc-b57d-ab88eea8eb99 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.664455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.665224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.665509 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.665786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.666682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:06.667273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.668474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.671757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 186/350] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:06.672623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.682506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 165/351] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.683647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.719779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.819433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18846c0-c4b4-454c-969d-12def960026f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.827632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88417f-02c6-4088-9cc9-fd33d08f9353 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:06.852027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:06.870276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.870966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.871254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.871532 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.872302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:06.872618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:06.874031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:06.874511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:06.876923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:06.877399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:06.877858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:06.884313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 166/352] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:06.887388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:06.893398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:06.901628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:06.902742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 187/353] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:06.904072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.032182 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3fcfb-4428-4e1f-aecd-c6d2ce798817 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.038373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.044217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b5635-404c-44f4-b892-488af5d96df5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.086373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.087018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.087311 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.087591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.087962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.089359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.089838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.090333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.109536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:07.126991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:07.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:07.128802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:07.133156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 188/354] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:07.135052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.156468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.175600 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.177173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.270115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd3e2-4fad-4e83-badb-6c10d39f5043 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.326950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.327712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.328069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.328349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 167/355] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:07.328772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.329872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.364113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.416251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.417776 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.436625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.456485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761c8b7-1cc6-4784-9e3d-d6f14128dad7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.502809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.503489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.503789 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.504302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.505969 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:07.505969 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.507818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.520912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 168/356] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.520912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.546330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 189/357] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:07.547227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.618505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.641127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185738-0d7e-41c2-b27d-2c3964f8a8dd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.670026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df2a9b-094d-42d3-93c9-18bf2ec9ede0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.681084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.682015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.682304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.682583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.683349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:07.683664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.685075 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ac375-ec49-4d2f-b58f-1411b493a4c4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.694980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 169/358] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.696645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79845a-772c-43e5-a8cc-6349ead956bc None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.697049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79845a-772c-43e5-a8cc-6349ead956bc None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.697339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79845a-772c-43e5-a8cc-6349ead956bc None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.699052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 170/359] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:07.699405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79845a-772c-43e5-a8cc-6349ead956bc None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.713818 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.714863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.715218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.715500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.716713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.716996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.718213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.720190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 190/360] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.720661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:07.833677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79845a-772c-43e5-a8cc-6349ead956bc None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.862796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bf1d3-6b5e-4536-9b7b-1cb47947818f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:07.878269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.878854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.879142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.879424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.897048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:07.911060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:07.912146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.912484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.912762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.914051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.915592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bb785-2f8f-4021-8c53-873e3a5ff999 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.917454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 191/361] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:07.918520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:07.918814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:07.919182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:07.938142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:07.939364 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:07.964344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:07.966439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:07.979671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.032584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 192/362] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:08.033651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.106492 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 171/363] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:08.107352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.166360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0f200-785c-49fb-b702-8173cb3ba7d9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.194634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.210545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.210906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.211187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.233886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25675-3f51-4433-b827-684002bfbdda None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.247329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.277537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.278420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.278975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.279256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.290973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.292465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.294308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 172/364] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.310583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.312420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.433752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd22a-c9c2-4dff-9048-7929a89296b0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.446693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 193/365] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:08.447808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.478985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.481499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.482364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.482664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.482935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.484154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.485568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.487182 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 173/366] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.487959 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.536675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.557648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd2bd-81f8-45d6-9110-524f9851702c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.592302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.593117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.593404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.593558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc5d8-83f3-4fbb-88e8-b3ae8e500562 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.593696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.605539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:08.613529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:08.615058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 194/367] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:08.616390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.631543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.632406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.632693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.633019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.634206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.635641 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.637545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 174/368] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.638225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.701740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.721021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0813389-36da-45bd-bc17-7e3622252b85 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.737868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb638-5f2e-4452-bdb6-f7207767b573 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.748439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.754613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.755269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.755546 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.755818 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.756697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:08.757040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.758483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.763765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 195/369] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=7f83d786d22243dab58a39a437993025 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.764545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.781062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.782072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.782357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.782633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.784059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.785960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.792270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 175/370] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.792270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.887611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979cd81-8aae-41a6-a98a-0d6f36bc527b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.924282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96866e72-93cb-4bc4-a42a-c593de9614f2 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:08.929250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.929924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.930216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.930499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.931763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:08.931763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.933302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.940460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 196/371] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.949007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:08.962844 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:08.976293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:08.977072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:08.977360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:08.977754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:08.978552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:08.978960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:08.980390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:08.992538 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 176/372] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:08.993788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.059604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:09.080336 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5ecd7-f4fe-476a-813a-6184b4f628a4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.122928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.123498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.123791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.124448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.126099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.128403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.130598 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 197/373] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.132139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.133870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efddc-edcf-440d-a203-41c3889db500 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.190128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.193163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.195704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.196249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.197861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.200144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.202866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 177/374] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:08 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.203745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.235264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:09.259231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c027-9e04-4f2e-a25c-e8f4f9409c99 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.295789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.296450 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.296741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.297051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.314829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fd825-d340-44b5-81e7-43a32394652f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.324769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:09.355114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.356293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.356728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.357176 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.358649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=256b7911e12842048a193e5662619853) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:09.359114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.361145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.369188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 178/375] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=256b7911e12842048a193e5662619853&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.370672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.372600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.374372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.470128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:09.498429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 198/376] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:09.506087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.518649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7bb7b-3287-41d1-a3d6-f5944bafe075 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.562266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.562936 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.563225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.563506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.565192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=7f83d786d22243dab58a39a437993025, scope.project.id=256b7911e12842048a193e5662619853) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:09.565515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.567021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.574364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 179/377] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=256b7911e12842048a193e5662619853&role.id=7f83d786d22243dab58a39a437993025 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.710117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c21af-121f-48e0-9b74-537b4cf71270 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.767148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.767933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.768217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.768482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] PATH_INFO: `/v3/projects/75a3ebcd7160438e930735c88021e880` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.769707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] RBAC: Authorizing `identity:get_project(project_id=75a3ebcd7160438e930735c88021e880)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.771154 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.773313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 199/378] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/projects/75a3ebcd7160438e930735c88021e880 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.779348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:09.828631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:09.915955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968426dd-9a26-4545-a5cb-dc8d0bbc5a3f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:09.966480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:09.967355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:09.967646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:09.967922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] PATH_INFO: `/v3/groups/26b6cb2e8a3547658211851a2e899fbf` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:09.976958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] RBAC: Authorizing `identity:get_group(group_id=26b6cb2e8a3547658211851a2e899fbf)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:09.978480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cb995-15da-4702-9852-87d8025ae4f2 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:09.980407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 180/379] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/groups/26b6cb2e8a3547658211851a2e899fbf => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:09.985931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:10.058252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:10.133561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d78c-8d7a-4939-b685-7552059f3f54 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:10.175813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:10.176469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:10.176756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:10.177061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:10.178475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] RBAC: Adding query filter params (group.id=26b6cb2e8a3547658211851a2e899fbf, role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=75a3ebcd7160438e930735c88021e880) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:10.178788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:10.180209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed824c8d-6cf3-4ef4-a53b-3db045e3fbbf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:10.186032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 200/380] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:09 2022] GET /identity/v3/role_assignments?group.id=26b6cb2e8a3547658211851a2e899fbf&scope.project.id=75a3ebcd7160438e930735c88021e880&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:11.139453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463a8-c206-469b-8c12-fdfe751a8b30 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.139996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463a8-c206-469b-8c12-fdfe751a8b30 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.140333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf463a8-c206-469b-8c12-fdfe751a8b30 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.143042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 181/381] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:11.148244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.149055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.149477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.167505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:11.169064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:11.241804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 201/382] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:11.265498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf463a8-c206-469b-8c12-fdfe751a8b30 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.385289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.390135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf463a8-c206-469b-8c12-fdfe751a8b30 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.438099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.439314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.439793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.440259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.469092 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-c7b76a89-d55c-4f0c-9d38-72d35e492545 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:11.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:11.479448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:11.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 182/383] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:11.489981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.571298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.602060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede060-5a4a-4a01-a679-1cf6ad9740a7 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.602715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede060-5a4a-4a01-a679-1cf6ad9740a7 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.603058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eede060-5a4a-4a01-a679-1cf6ad9740a7 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.608420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 183/384] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:11.609940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.610412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.610866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.650169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db490-fc39-4836-96a9-8c9641bf6e6d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.661628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:11.662890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:11.727650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.728326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.728607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.728895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.729657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:11.729960 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.731319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.753638 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 202/385] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:11.759439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.817669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 184/386] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:11.863087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.888878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3492a-ffb9-4680-b156-aa520f743de0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:11.890574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.951292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:11.952090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:11.952380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:11.952663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:11.957793 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:11.959330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:11.961879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 203/387] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:11.967835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:11.972939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:11.984513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74822b0a-05ed-47f7-a36a-ff09965c2e0f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.024218 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.025232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.025565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.025954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.038808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:12.047371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:12.049476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:12.050760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 185/388] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:12.056394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.137791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecb494-48e4-412a-9dc9-a2c8ac6798a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.194178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.195309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.195763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.196647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.198687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.201407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24485-f208-4698-b9ba-851eba924935 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.204547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 204/389] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:11 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:12.205998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54c3-24be-4e33-9793-d07b8baa9717 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.206441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868081df-7d77-49a1-9a25-d0cca6f7933c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.206981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54c3-24be-4e33-9793-d07b8baa9717 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.207625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54c3-24be-4e33-9793-d07b8baa9717 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.210711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 205/390] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:12.211700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f54c3-24be-4e33-9793-d07b8baa9717 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.256129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.257100 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.257530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.257950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.258883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:12.259520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.261910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773946-af3a-410a-8cda-27336a1a0e93 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.268399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.277045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 186/391] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:12.279695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.280463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.280989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.302705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:12.303961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:12.312699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.351146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f54c3-24be-4e33-9793-d07b8baa9717 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.393319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.394187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.394473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.394753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/groups/18f22ffdfb594e28899113e5008060cd/roles/7f83d786d22243dab58a39a437993025` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.397578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, group_id=18f22ffdfb594e28899113e5008060cd, role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.399029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01232d4e-a323-4cd1-97fa-00b78de0ddec None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.403743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 187/392] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:12.404767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.419083 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 206/393] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:12 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/groups/18f22ffdfb594e28899113e5008060cd/roles/7f83d786d22243dab58a39a437993025 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:12.420645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf8742-a612-46ba-8bd8-8841d77642d0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.421316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf8742-a612-46ba-8bd8-8841d77642d0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.421773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf8742-a612-46ba-8bd8-8841d77642d0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.423468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 207/394] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:12.435352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.436069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.436365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.478092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:12.479615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:12.567041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 208/395] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:12.568077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.568442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85586b-d30f-4126-85bf-6554c374db00 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.605759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.622964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.625548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.626263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.628464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.632205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.634412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.635771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 188/396] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:12.640339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.651062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.712957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89058-ebf5-4f82-bc9d-d145ea6b40ca None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.762458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.763185 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.763474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.763755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.776730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:12.782395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166a64-3812-4777-950a-ef0450818e25 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:12.785072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:12.785925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:12.786755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 209/397] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:12.787964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.829999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.831895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.832190 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.832490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.849545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:12.862320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:12.863857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:12.864960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 189/398] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:12.866396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:12.919206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.935602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6047d96-9485-4363-ae1a-69a449a5dbb8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:12.958150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.986213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:12.986213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:12.986213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:12.986213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:12.986735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:12.988071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:12.994696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 210/399] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:12.994696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.003930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef88ad-0d92-49b1-90aa-55b6a33d55ae None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.043724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.044329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.044611 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.044915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.045676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:13.045992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.047359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe972e1-a72e-4f17-be46-042a94579f47 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.056545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 190/400] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.057927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd900-59a0-4a52-8a0b-a92cb0fd07b9 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.058223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd900-59a0-4a52-8a0b-a92cb0fd07b9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.058501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd900-59a0-4a52-8a0b-a92cb0fd07b9 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.060039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 191/401] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:13.064676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd900-59a0-4a52-8a0b-a92cb0fd07b9 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.110870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4e37f-884a-487d-864e-0849ff2c0cbc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.148742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.149926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.150231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.150516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.151287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:13.151986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.154012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.165146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 211/402] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.166307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.187674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd900-59a0-4a52-8a0b-a92cb0fd07b9 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.189854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.219869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.228345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.229288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.229639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.229923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/groups/18f22ffdfb594e28899113e5008060cd/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.232797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a813a5b8f1f43a7932cbfa8f5026390, group_id=18f22ffdfb594e28899113e5008060cd, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.234932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133ca8-6e67-49e4-96a8-94f8e90340d5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.260883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 192/403] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:13 2022] PUT /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390/groups/18f22ffdfb594e28899113e5008060cd/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:13.260883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.260883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.260883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.291178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9cfd-bee2-4cc2-b16e-d6ab3a163f55 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.291718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:13.292513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:13.336164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.337216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.337508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.337791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.339905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.341706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.344134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 212/404] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.345001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.384528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 193/405] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:13.390514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.473835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.500634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a0b0-fb62-48bd-a6c5-2d717212a0d9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.539628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d22c6-fe8e-4bdf-90a1-df569bfbcd3d None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.549228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.550990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.551500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.551976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.554335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.556714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.563717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 213/406] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.563717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.581260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.588655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.590394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.590963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.595188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.598850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.601802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.604115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 194/407] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.605429 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.680358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e03805-c480-417a-8025-5f772f539b5c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.716826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.717750 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.718042 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.718320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.725672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4e5a-d892-41d8-8e9d-d0d5047a2175 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.730434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:13.738616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:13.739671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:13.740563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 214/408] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:13.746656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.758266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.775910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.777265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.777868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.778682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.780130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.781983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.789053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 195/409] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.790289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.855545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:13.864987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de24c3-5fa8-4cec-a860-f13e867689e7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.902343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.903238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.903827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.904113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/groups/18f22ffdfb594e28899113e5008060cd/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.905409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161127-74dc-4d7f-9259-2d3222feb348 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:13.906124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, group_id=18f22ffdfb594e28899113e5008060cd, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.907678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.922597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 215/410] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:13 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/groups/18f22ffdfb594e28899113e5008060cd/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:13.923515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:13.951477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:13.952556 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:13.953107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:13.953586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:13.954859 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:13.955557 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:13.957312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:13.968202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 196/411] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:13.975143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.014900 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.047669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da010-a4bc-4988-8e97-b52d6c3afd7d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.088068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.089121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.089355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.089602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853/groups/18f22ffdfb594e28899113e5008060cd/roles/7f83d786d22243dab58a39a437993025` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.092144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=256b7911e12842048a193e5662619853, group_id=18f22ffdfb594e28899113e5008060cd, role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.093792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.113644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 216/412] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:13 2022] PUT /identity/v3/projects/256b7911e12842048a193e5662619853/groups/18f22ffdfb594e28899113e5008060cd/roles/7f83d786d22243dab58a39a437993025 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:14.134587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496866-a448-4049-b4a8-95ac52c521c1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.166253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.182817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.183699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.183984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.184265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] PATH_INFO: `/v3/groups/26b6cb2e8a3547658211851a2e899fbf` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.186830 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] RBAC: Authorizing `identity:get_group(group_id=26b6cb2e8a3547658211851a2e899fbf)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.188318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.190161 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 197/413] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:13 2022] GET /identity/v3/groups/26b6cb2e8a3547658211851a2e899fbf => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:14.197476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.317869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49528a8-8cc5-476e-a18b-b78106409a47 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.357443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.358377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.358672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.358955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] PATH_INFO: `/v3/projects/75a3ebcd7160438e930735c88021e880` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.360557 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] RBAC: Authorizing `identity:get_project(project_id=75a3ebcd7160438e930735c88021e880)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.362032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4831f-9690-4105-b60f-c18d85288041 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.364164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 217/414] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:14 2022] GET /identity/v3/projects/75a3ebcd7160438e930735c88021e880 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:14.370213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.533992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce5a-da6a-4225-9fbc-93fa51b372f4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:14.580987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:14.582172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.582602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.583022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] PATH_INFO: `/v3/projects/75a3ebcd7160438e930735c88021e880/groups/26b6cb2e8a3547658211851a2e899fbf/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.585758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] RBAC: Authorizing `identity:create_grant(project_id=75a3ebcd7160438e930735c88021e880, group_id=26b6cb2e8a3547658211851a2e899fbf, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:14.587360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6da9-8fd9-41dc-8ee7-f685a6391451 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:14.610246 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 198/415] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Jul 11 14:26:14 2022] PUT /identity/v3/projects/75a3ebcd7160438e930735c88021e880/groups/26b6cb2e8a3547658211851a2e899fbf/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:14.707622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e347f-07fd-4a16-9f70-19145d991371 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.707929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e347f-07fd-4a16-9f70-19145d991371 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.708108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e347f-07fd-4a16-9f70-19145d991371 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.710560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 218/416] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:14.716285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:14.716623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:14.716891 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:14.737401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:14.738647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:14.810554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.844741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 199/417] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:14.869305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e347f-07fd-4a16-9f70-19145d991371 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:14.874365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:14.986563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e347f-07fd-4a16-9f70-19145d991371 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.022389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.023635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.024113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.024578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.036127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:15.045278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:15.046179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:15.046945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:15.049726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 219/418] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:15.055839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.163992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c42b7-b08f-4e5d-9d7b-30727a9e451b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.209673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.210822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.211300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.211779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.212742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:15.213275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:15.214859 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:15.229226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 200/419] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:15.235027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.319377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:15.363671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23072e45-99fe-440d-8273-5cfdd68c1b92 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.413059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.414098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.414576 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.415039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.531796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:15.533303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:15.625447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:15.680671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 220/420] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:15.687924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.757604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:15.823771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bba95-3832-49dc-bf76-d733d6b1d901 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:15.879298 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:15.880108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.880399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.881214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.883410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:15.884951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258b24e-7e3e-4890-be36-983783070728 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:15.886692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 201/421] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:15.892331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:15.962668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612032-d0e6-4188-91f0-75e0820d2aea None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.962985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612032-d0e6-4188-91f0-75e0820d2aea None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.963233 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0612032-d0e6-4188-91f0-75e0820d2aea None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:15.964772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 202/422] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:15.978697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:15.978983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:15.979261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.004064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:16.005303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:16.046043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96eead-a97c-4768-9398-b983702d8b69 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.095142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 203/423] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:16.113072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.113941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.114227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.114502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.115745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:16.117234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:16.118955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 221/424] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:15 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:16.124911 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.134381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.200512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.202328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.311235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665badf-c0ff-4557-b2c8-3b9ced91c293 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.350865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb5fa5-74c0-4b23-a6ef-624fd67128de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.383357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.384490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.385204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.387200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.388387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:16.389950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:16.391646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:16.405588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 204/425] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=7f83d786d22243dab58a39a437993025 => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:16.418163 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.419376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.419858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.420328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.433368 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:16.441866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:16.442800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:16.443641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:16.451019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 222/426] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:16.453658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.586313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3a8c-4b6c-4f78-8812-8873c286aa54 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.595120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.627810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.628914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.629403 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.629880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.630924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:16.631443 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:16.633057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc798d7c-7e20-48b4-b800-879732abdd8c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:16.647303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 205/427] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:16.648947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:16.753894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:16.770662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0940a3-e3d6-4f43-b3d0-73cdcd280dcc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:16.809942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:16.810957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.811443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.811938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.892678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:16.894505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:16.975598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af6c4-5b8e-4a3c-b9b2-48e2633af636 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.976102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af6c4-5b8e-4a3c-b9b2-48e2633af636 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.976178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5af6c4-5b8e-4a3c-b9b2-48e2633af636 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:16.977816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 206/428] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:16.983021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe57e-a403-4bae-9551-bf15663fefc0 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:16.983310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe57e-a403-4bae-9551-bf15663fefc0 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:16.983593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fe57e-a403-4bae-9551-bf15663fefc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.000350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f47fe57e-a403-4bae-9551-bf15663fefc0 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:17.001601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f47fe57e-a403-4bae-9551-bf15663fefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:17.002071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.018700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 223/429] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:17.020217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.093006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 207/430] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:17.094415 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154f16-161b-44d8-9dcb-f053413facf4 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.094952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154f16-161b-44d8-9dcb-f053413facf4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.095237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154f16-161b-44d8-9dcb-f053413facf4 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.100991 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 208/431] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:17.104890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.105027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.105369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.122062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:17.123249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:17.136690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc70de-6dab-422e-b731-d795865ff648 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.174457 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.175391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.175763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.175951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] PATH_INFO: `/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.177237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] RBAC: Authorizing `identity:get_project(project_id=9a813a5b8f1f43a7932cbfa8f5026390)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.178722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.185183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 224/432] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/projects/9a813a5b8f1f43a7932cbfa8f5026390 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.185835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.199458 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 209/433] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:17.200325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.237840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.252104 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.303772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ef5e4-bbff-4468-94f7-06056c4f8521 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.321830 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32316-2a36-4d24-9460-2f9b9db9e056 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.341587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.342408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.342689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.342960 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.354722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:17.359337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.360208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.360495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.360772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.362002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:17.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:17.364011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:17.364792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:17.365483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.365553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 225/434] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:17.366086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.369652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 210/435] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.370708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.470989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.482304 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf196-77d7-4ceb-8d67-6aee783703e6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.482491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08f7e-ddbe-4199-805a-4aa34e01514c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.499809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.517937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.518181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.518632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.518731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.518976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.519078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.519199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.519286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.519970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:17.520279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.521736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.530148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:17.531201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 211/436] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.531795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-90a45b1a-7204-4d39-8ed8-7caf1c2b00a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:17.539700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:17.540926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 14:26:17.541813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:17.542412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 226/437] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:17.543677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d13faa-c1e8-4176-8373-a3546646cec5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.544006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d13faa-c1e8-4176-8373-a3546646cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.544297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d13faa-c1e8-4176-8373-a3546646cec5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.545747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 227/438] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:17.548364 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d13faa-c1e8-4176-8373-a3546646cec5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.640249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1b200-317b-433c-ad95-b02327d5e106 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.651230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d13faa-c1e8-4176-8373-a3546646cec5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.673689 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.674345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.674631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.674914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.675758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:17.676174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.678092 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.683951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 212/439] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=9a813a5b8f1f43a7932cbfa8f5026390&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.684728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.684963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.685613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.685902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.686188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.706438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.749112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.779679 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.781218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.805650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc2b-e641-479a-91b2-777a2c806f96 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:17.844811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:17.845524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.845812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.846090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:17.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:17.848553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76a145-9c0d-4dac-b80b-2048d7aa95a1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:17.858431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 213/440] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:17.859742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:17.859967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:17.860244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:17.879231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:17.880420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:17.898908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 228/441] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:17.901828 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.975757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 214/442] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:17.980951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:17.989148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:17.994956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.023243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91cdd1-2923-45c6-a36e-2a4734577fdb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.069577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.070188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.070474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.070753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.098409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6069a5e-7ad6-4d77-9813-c337513617ac None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.139579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.140448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.140728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.141047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.142289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.143714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.145513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 215/443] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.146925 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.160200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.162212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.238674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.247717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.261664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff511e5-7472-48ed-97c1-f3c47e349244 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.270460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 229/444] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:18.271346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.301388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.302188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.302983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.303278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.313312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:18.321707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:18.322569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:18.323542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 216/445] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:18.325272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.369710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2726a-e3df-4299-b338-ad87ca408abb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.405380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.406242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.406524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.406797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.407961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.409446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.411179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 230/446] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.411971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.424240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a518ab-9d45-4bb4-9ae7-55ebc99d1102 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.458344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.459214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.459502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.459780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] PATH_INFO: `/v3/projects/256b7911e12842048a193e5662619853` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.460273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.461015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] RBAC: Authorizing `identity:get_project(project_id=256b7911e12842048a193e5662619853)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.462646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.464495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 217/447] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/projects/256b7911e12842048a193e5662619853 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.468292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.477543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.514791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58a7d-a14c-462b-b5b9-16e3da8d7ea5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.546762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.547418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.547698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.547976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.548724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:18.549055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.550435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.558851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 231/448] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.559625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.569437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e51fb6-7932-47ac-8ef5-73e73c058f4a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.602251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.602820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.603101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.603373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.604214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=7f83d786d22243dab58a39a437993025, scope.project.id=256b7911e12842048a193e5662619853) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:18.604520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.605983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.620177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 218/449] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=256b7911e12842048a193e5662619853&role.id=7f83d786d22243dab58a39a437993025 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.620177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.671248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba991db-b831-4218-888b-d8c877521787 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.681926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.700816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.710868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.711855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.712146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.712424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] PATH_INFO: `/v3/groups/18f22ffdfb594e28899113e5008060cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.713698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] RBAC: Authorizing `identity:get_group(group_id=18f22ffdfb594e28899113e5008060cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.715179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.721968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 232/450] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/groups/18f22ffdfb594e28899113e5008060cd => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.722839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:18.737090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d21c-f405-4dc6-9f6e-4660d369d478 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.777205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.777437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.777661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.777943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.842728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677c28d-60e4-46e2-a1e2-b5174fa69f98 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:18.854873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.856258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.876287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:18.876966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:18.877256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:18.877534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:18.878365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] RBAC: Adding query filter params (group.id=18f22ffdfb594e28899113e5008060cd, role.id=ad3f7de6169e46818a2e6e66d91aacc2, scope.project.id=256b7911e12842048a193e5662619853) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:18.878682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:18.880108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:18.885831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 233/451] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/role_assignments?group.id=18f22ffdfb594e28899113e5008060cd&scope.project.id=256b7911e12842048a193e5662619853&role.id=ad3f7de6169e46818a2e6e66d91aacc2 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:18.923839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:18.958169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 219/452] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:18.963880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.008034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.068381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae9fc8-6eb7-4b87-a34e-5dc2f72388eb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.102347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.103213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.103498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.103774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] PATH_INFO: `/v3/projects/75a3ebcd7160438e930735c88021e880` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.105047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=75a3ebcd7160438e930735c88021e880)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.106433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.108146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 234/453] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:26:18 2022] GET /identity/v3/projects/75a3ebcd7160438e930735c88021e880 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.113794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.213647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018ec4-cb56-453e-8498-aa990cd3d962 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.247858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.248718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.249081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.249363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] PATH_INFO: `/v3/groups/26b6cb2e8a3547658211851a2e899fbf` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.250531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] RBAC: Authorizing `identity:get_group(group_id=26b6cb2e8a3547658211851a2e899fbf)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.251968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6bca1-68e7-412b-949b-882da8787cfe None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.253642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 220/454] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/groups/26b6cb2e8a3547658211851a2e899fbf => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:19.259623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.361468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d220ab5-d277-4fa4-97c1-2288acf6b4a7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.371342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.397194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.397846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.398131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.398407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.399237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] RBAC: Adding query filter params (group.id=26b6cb2e8a3547658211851a2e899fbf, role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=75a3ebcd7160438e930735c88021e880) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:19.399548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.400993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803496f-7a67-4bc8-97e0-c6c845ce9c2e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.406858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 235/455] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/role_assignments?group.id=26b6cb2e8a3547658211851a2e899fbf&scope.project.id=75a3ebcd7160438e930735c88021e880&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:21.887002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2dfa-596c-447f-89e9-fab7da001b13 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.887978 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2dfa-596c-447f-89e9-fab7da001b13 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.888489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2dfa-596c-447f-89e9-fab7da001b13 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.890336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 221/456] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:21.895311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.895750 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.895926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.917399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:21.918580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:21.995241 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de650879-0dd3-4756-a101-2fadc91abfc8 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.995555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de650879-0dd3-4756-a101-2fadc91abfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.995793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de650879-0dd3-4756-a101-2fadc91abfc8 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.997456 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 222/457] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:22.002142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.002431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.002706 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.013559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 236/458] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:22.030696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:22.031875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:22.039699 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.063237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.104314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 223/459] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:22.128084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.233775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1cda-df3d-4f4a-a20a-3ec7e063a500 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.268873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.269854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.270231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.270599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.282611 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.284046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.301678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4393da-5d90-4512-b636-add4f3686816 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.305530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:22.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:22.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:22.325984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:22.325984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:22.325984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:22.325984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:22.334570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 224/460] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:22.337281 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.375189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.375988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.376268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.376540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.377616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.397023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.399528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-840316c5-d61a-4bd0-8a44-f59f8577d830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:22.427992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:22.428933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:22.429783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:22.429783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:22.429783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:22.429783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:22.431315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 237/461] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:22.434041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb981e-2ec6-491d-9a8a-6ddbefe97254 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.434566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb981e-2ec6-491d-9a8a-6ddbefe97254 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.435701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb981e-2ec6-491d-9a8a-6ddbefe97254 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.441459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 238/462] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:22.441459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb981e-2ec6-491d-9a8a-6ddbefe97254 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.493607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37625f6f-d18b-4406-bee1-6fd7af7da5d6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.537223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.538219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.538524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.538788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.539525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:22.539828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.541699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5ece-6e7e-43d8-8119-a87c611cb3e7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.564491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb981e-2ec6-491d-9a8a-6ddbefe97254 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.568930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 225/463] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:22.571336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.571631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.571912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.598594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:22.600982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:22.608458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.609164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.609453 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.609731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.610469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:22.610780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.612318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.626217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 239/464] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:22.627293 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.647601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.692272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 226/465] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:22.701748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.720026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:22.750169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9660c-f355-42a4-b994-1417cac65ff3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.793261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.794748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.795523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.796013 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.797099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.799541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.832868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 240/466] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:22 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:22.832868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:22.843130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b80fd-adc0-495f-bf4f-3a3476127bcb None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:22.901640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:22.902435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.902615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.902884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.903875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:22.905449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c8700-612a-430f-9007-a672b20cc73e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:22.931323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 227/467] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:22 2022] POST /identity/v3/users => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:22.938102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde22b-de71-4139-b3d3-b1c59f54592c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.938411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde22b-de71-4139-b3d3-b1c59f54592c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.938663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcde22b-de71-4139-b3d3-b1c59f54592c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.945371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 228/468] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:22.952673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd68c-3112-4b22-88d3-54f5877ce5ae None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:22.953940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd68c-3112-4b22-88d3-54f5877ce5ae None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:22.954237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fd68c-3112-4b22-88d3-54f5877ce5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:22.990671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a87fd68c-3112-4b22-88d3-54f5877ce5ae None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:22.991922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a87fd68c-3112-4b22-88d3-54f5877ce5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:22.994742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.045000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc526-6f63-45cd-b5e0-721bcf6da5fb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.075336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.085597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 229/469] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:23.091548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.092377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.092667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.092981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.097312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b88f3-2465-4571-9308-628c17960d4c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.097496 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b88f3-2465-4571-9308-628c17960d4c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.097688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b88f3-2465-4571-9308-628c17960d4c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.099342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 230/470] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:23.108359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.110067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.110482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.110868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.111226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:23.129439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:23.130981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 241/471] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:23.132343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.137214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:23.138437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:23.220905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 231/472] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:23.221739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.260764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1501-eaa6-4f7c-b72c-db0ed7e156d6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.290643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.313989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.315660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.316385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.316886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.333024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.335178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.349638 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112aeb2-1c69-45f1-8d44-889a43f6f032 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:23.362301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:23.363170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:23.364000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:23.364000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:23.364000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:23.364000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.372076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 242/473] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:23.372076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.384672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.395092 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.395818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.396191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.396501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.397295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:23.397605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.398995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.412636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 232/474] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:23.417665 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.508733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084fdf5-1fec-46f1-b10e-7b243466f447 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.546268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.547324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.547890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.548366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.549191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c578-e22d-44a1-9a10-4ad23ae1fa0a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.549590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.551195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.559859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:23.559859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:26:23.559859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [parameters: {'id': '9e9af2682b9a482496d87666f46bf54f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:26:23.559859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jul 11 14:26:23.577778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:26:23.578785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:26:23.579663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:26:23.580711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:26:23.581608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:26:23.583196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'id': '9e9af2682b9a482496d87666f46bf54f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:23.585259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 14:26:23.587017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:23.588712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 243/475] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:23.588712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.604179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.605482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.605968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.606973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.608149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:23.608629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.610937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.630591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 233/476] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:23.630591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.641442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.687275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.712053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c85f-614d-409d-ab14-2a94469215a0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.744929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1fbd-b9b9-46a3-ac26-f52b4b86ccce None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.750807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.751769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.752247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.752810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.753731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.755491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.781429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 244/477] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:23.783171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.813737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.814574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.814856 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.815136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.834746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:23.851493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:23.852436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:23.853657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 234/478] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:23.861890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:23.909809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149c973-1086-4519-9a43-d1acd04594d3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:23.921279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:23.950211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:23.951332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:23.951844 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:23.952407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:23.953496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:23.955247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5a4d-6787-4a5a-b7f9-549064c45270 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:23.993752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 245/479] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:23 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:24.022701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cce39-2b52-4761-98e7-b33315c37c26 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:24.031085 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:24.062162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:24.062845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:24.063132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:24.063408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:24.064185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:24.064497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:24.065942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369152c8-5f8d-4b99-b158-1f05220fe14e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:24.075798 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 235/480] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:25.257251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2fbc-1f46-4527-8f39-ad4d49aa0eb4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.257767 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2fbc-1f46-4527-8f39-ad4d49aa0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.257842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2fbc-1f46-4527-8f39-ad4d49aa0eb4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.259466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 246/481] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:25.264348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bddc-aad0-4678-a9d6-67a8cc6ae4a9 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.264748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bddc-aad0-4678-a9d6-67a8cc6ae4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.264938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10bddc-aad0-4678-a9d6-67a8cc6ae4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.285847 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-be10bddc-aad0-4678-a9d6-67a8cc6ae4a9 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:25.287237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-be10bddc-aad0-4678-a9d6-67a8cc6ae4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:25.379655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 236/482] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:25.414243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce2fbc-1f46-4527-8f39-ad4d49aa0eb4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.442466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d60d9-fc2f-4916-a493-da21a0537f73 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.442847 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d60d9-fc2f-4916-a493-da21a0537f73 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.443078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d60d9-fc2f-4916-a493-da21a0537f73 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.444710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 237/483] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:25.449458 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.449750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.450033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.477042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:25.478252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:25.555380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce2fbc-1f46-4527-8f39-ad4d49aa0eb4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.618685 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.619483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.619770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.620050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.634142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 238/484] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:25.641431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:25.649314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:25.650166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:25.651353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 247/485] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:25.656514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.692884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.703100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.725256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:25.831616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573ed75-1515-43d1-8f9f-f0c9729cce13 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.875866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa6b3c-beba-440e-b617-f76cc4761473 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:25.909478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.910583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.911076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.912102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.913256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:25.913779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:25.915335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:25.921159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:25.921159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:25.921159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:25.921159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:25.930617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:25.934201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 239/486] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:25.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:25.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:25.940134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 248/487] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:25.942156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:25.945490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.018565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.052545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6f9ce-35b4-4f4b-b87f-20d421e52053 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.088689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.089316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.089618 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.089901 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.090679 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:26.091101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.092641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.102018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 249/488] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:26.105250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.108567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.127807 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5558-7114-46a0-9b8d-7a3cd597fea9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.189110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.190163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.190599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.191967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.219577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.221296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:26.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:26.251277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:26.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:26.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:26.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:26.252261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:26.258619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 240/489] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:26.264042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.269466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff07a7-bbdb-4317-9848-f984273ee5b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.301273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.313551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.314780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.315242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.315693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.335505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.342497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:26.376385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:26.377535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:26.378583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:26.378583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:26.378583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:26.378583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:26.381107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 250/490] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:26.386775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.399807 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ce9d2-7f50-474e-843f-9c07fc37d9f1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.438046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.438985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.439421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.439882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.440817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:26.441448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.443583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dc71c-04ee-4467-9c91-a9b858d7d338 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.456952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 241/491] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:26.459313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40c06-ee35-4728-b763-a4af9912a6a4 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.459805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40c06-ee35-4728-b763-a4af9912a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.460307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d40c06-ee35-4728-b763-a4af9912a6a4 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.462319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 242/492] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:26.463400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40c06-ee35-4728-b763-a4af9912a6a4 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.466552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.501992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a06ce7-a98a-4462-8803-3dce98c2b29d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.537014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.537713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.537966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.538244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.538998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:26.539278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.540643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203992fb-c0d9-47b4-a1c3-8afdd31f2dcf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.556993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 251/493] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:26.556993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.556993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.556993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.573691 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:26.574882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:26.587211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d40c06-ee35-4728-b763-a4af9912a6a4 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.620483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.623670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.624454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.624837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.625047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.632967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.634418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.649061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 252/494] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:26.649061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-9ee1f548-658a-46b9-8229-c532dc5dd60f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:26.651096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:26.652132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:26.653464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 243/495] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:26.654022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14069a02-acb1-4aa0-9a5a-5634f4253c9c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.654022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14069a02-acb1-4aa0-9a5a-5634f4253c9c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.654144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14069a02-acb1-4aa0-9a5a-5634f4253c9c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.655306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 244/496] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:26.660143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14069a02-acb1-4aa0-9a5a-5634f4253c9c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.732727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.756951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3323-e821-423c-90d9-e7b85745b353 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.776871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14069a02-acb1-4aa0-9a5a-5634f4253c9c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.792984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.793785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.794055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.794325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.801749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.803719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.817469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:26.818823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.819178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.819570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ab69c05c-e79e-46c1-9cd4-0c5c2f1acdad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:26.820338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:26.821192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:26.822469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:26.823194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:26.823194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:26.823315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 253/497] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:26.823315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:26.823436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:26.823702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:26.827064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:26.842936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:26.844140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:26.863250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 245/498] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:26.864087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.871943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:26.913567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 254/499] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:26.914409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:26.972873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c919f-b256-4710-980d-514761f04025 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:26.993251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.007391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.007945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.008323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.008513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.013142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14952f03-6838-484d-a5a5-1364e86b49ed None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.018542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7b056377-a5ba-4406-acec-cad4a70d1e98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:27.026278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.027134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:27.027921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 246/500] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.028939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588c2f-1cb3-4519-9e36-5d12fad2d53c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.029399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588c2f-1cb3-4519-9e36-5d12fad2d53c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.029513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40588c2f-1cb3-4519-9e36-5d12fad2d53c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.033111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 247/501] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:27.034049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588c2f-1cb3-4519-9e36-5d12fad2d53c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.049315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.049988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.050274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.050554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.051403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:27.051715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.053749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.093067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 255/502] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:27.093897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.118222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.139418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40588c2f-1cb3-4519-9e36-5d12fad2d53c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.173759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.174408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.174695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.174977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.192354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba23e1f-2181-4ed7-8836-dbc94ac2efc7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.222061 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.226738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.227581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.227814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.228090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.238451 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:27.241838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.243302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a7c6-dc86-4a7c-9be0-eb8fa069f92f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:27.246759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.247827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:27.248658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 256/503] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.249339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.333773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.346354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 248/504] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:27.347818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.348111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.348422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.352166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d73d0-bfa8-47a8-a214-7795ea6ea61c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.366306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:27.367395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:27.387269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.387930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.388214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.388490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.389274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:27.389654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.390961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.399242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 257/505] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:27.400041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.435372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 249/506] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:27.436213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.461815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.506415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8485910-657d-4479-81a1-0b5438778676 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.539698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.539994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.540285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.540575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.551096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6520e-054e-4a4c-9ff3-02db136e8f34 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.555003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.592454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.593148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.593436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.593714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.594472 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:27.594782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.596145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.604422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 250/507] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:27.605332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.610374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.611858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.674733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.704666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2ec67-5af9-4a9e-ba6e-2e46b9a052e5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.710418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 258/508] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:27.711254 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.740283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.741104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.741392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.741668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.752275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.753768 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.758724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:27.770811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.771676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:27.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:27.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:27.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 251/509] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.773110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.818506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420475-dbe4-4e41-a67e-423cf959f9de None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.857928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.858726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.859015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.859299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.870168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.871633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.875283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f2-7475-45c4-8a5e-ce9e987754eb None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:27.889351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.890215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.891032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:27.891032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:27.891032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.891032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:27.891032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 259/510] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.891434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.902735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.915191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:27.915985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:27.916277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:27.916560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:27.927801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:27.928507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:27.949191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:27.950255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:27.951102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:27.951102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:27.951102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:27.951102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:27.951102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 252/511] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:27.951376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:27.988919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:27.995374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d613-4e6f-4d24-814b-dd36017bb2d8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.028265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.029089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.029375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.029647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.040614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.042119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.057659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357d318-5554-4cfa-be27-83096e120174 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:28.058877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:28.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:28.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:28.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:28.060654 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 260/512] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.061470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.093828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.094617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.094899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.095169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.105628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.107064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:28.124032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.124920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.125755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:28.125755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:28.125755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:28.125755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:28.125755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 253/513] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.126018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.153927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.164183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153b8da-baf0-494e-a44a-42aa8dc99163 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.198849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.199434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.199721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.200000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.200725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:28.201072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.202435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.214405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 261/514] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.215186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.226605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ca57-6d35-41d2-b88d-2e96b50e085f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.227199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.258976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.259906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.260929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:28.261236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.262592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.279349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 254/515] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.279349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.315273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24333020-5f73-48a5-8974-ddeb7d138741 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.348688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.349968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.350256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.350535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.351270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:28.351582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.352989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.364018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 262/516] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.364841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.365362 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.381252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e86a7-742b-4575-96f4-a46556ab5f01 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.420244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.420925 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.421209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.421490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.422225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:28.422523 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.423873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.431728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.435638 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 255/517] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.436960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.475487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0967e9e-0573-4d95-88ec-27e26f01bcc6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.512061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.512726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.513049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.513331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.514056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:28.514365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.515741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.528912 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 263/518] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:28.529817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.549412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a782-f820-4966-b44a-d94ff973f0c8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.583787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.584576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.584892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.585166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.591897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.593381 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:28.608581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.609619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:28.610460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 256/519] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.610929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.621301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.634563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6436-baec-40da-b332-f8dc0fcabe38 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.660488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.669078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.669875 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.670164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.670443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.677987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.679435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:28.693756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.694675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:28.695550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 264/520] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.696097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.711327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b1dc4-3127-4850-b0e0-5321e5583a0d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.746535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.747118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.747395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.747666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.748361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.749825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.768457 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 257/521] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:28 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:28.769290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.804813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521fed7-7d97-40d4-a25a-24b983e09681 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.842567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.843379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.843665 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.843943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.846017 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.852559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.854374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:28.870655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.871803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 265/522] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.873589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.899643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd1290-0cf6-455b-882f-cbe41b787ade None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:28.934354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:28.939335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:28.940147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:28.940424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:28.940725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:28.949274 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:28.950745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:28.965535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:28.966586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:28.967576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:28.969683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 258/523] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:28.971510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:28.999902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a07179-39c6-44fc-899f-46a0c3a1fd03 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.038965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.039633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.039919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.040203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.041039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.041349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.042774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.061731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 266/524] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.062565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.086869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29351-e9d5-410d-82e5-da0af84dbfd1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.114151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.125976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.126687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.126971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.127199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.128535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.128535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.129879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.152923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 259/525] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.152923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.181376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb4cb9-9324-44ad-b6ed-0817ebc859c5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.191633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.221064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.221740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.222134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.222420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.223394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.223706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.225260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.244993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 267/526] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.245825 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.261338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865b99e-dc98-40f8-9626-fa7917a588af None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.297982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.298737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.299091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.299440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.300682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.301116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.302667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.325894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 260/527] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.325894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.361475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6839-c5e1-458c-b63a-ea1957339961 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.368533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.398091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.398776 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.399059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.399333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.400170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=992d3b61b59d4208be7396a153d6231e) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.400473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.401947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.408048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 268/528] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/role_assignments?user.id=992d3b61b59d4208be7396a153d6231e&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.417968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.436251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccba16f-63c7-40bc-979c-5d1503b81874 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.471052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.483652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.484407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.484784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.485232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.569427 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.570918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.585116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119f80b-9146-434e-927b-b6df02873c43 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.621673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.632039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.633040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.633545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.634037 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.694193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 261/529] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:29.695234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.724342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.726775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.759298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.805211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3be92-df3f-487e-94f6-8549a992e167 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:29.841592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:29.842285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:29.842767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:29.843120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:29.844043 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:29.844671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:29.844793 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 269/530] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:29.845758 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.846180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:29.856987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 262/531] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:29.858036 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:29.883602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:29.996932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508633-a9a5-4a56-ad7b-58825efa3e5c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.037051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.037957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.038491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.038974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.052834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.054853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.077164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33655c2-ff24-4388-a0e7-7bb5f7409a1e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:30.077365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:30.078152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:30.078977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:30.078977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:30.078977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:30.078977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:30.079189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 263/532] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:30.084924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.135596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.136413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.136700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.137038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.150928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.152605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:30.175392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:30.176256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:30.177660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:30.177660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:30.177660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:30.177660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:30.181129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 270/533] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:30.183490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.291205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f542b-27bf-4b65-bb56-93c1a1aa438d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.298940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e38e2f-6611-4f9a-ad67-ab6460b0022d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.338807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.339484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.339773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.340053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.341251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:30.341573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.342963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.356647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 271/534] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:30.366477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.382413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.383017 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.383306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.383590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.384333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:30.384647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.386068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.402348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 264/535] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:30.409354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.433447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.507853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8aca-922a-422e-98cb-79de2775b0b3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.554073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.555065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.555451 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.555821 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.569684 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.571401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:30.599826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:30.600718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:30.601585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:30.607132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e67bcf-98d7-4307-b4a6-94386bbce47f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.614916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 272/536] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:30.615820 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.639149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.671795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.672581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.673150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.685184 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.689783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:30.705540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:30.706451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:30.707278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 265/537] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:30.713296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.807916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add14ff8-0c6a-4dfa-af4c-88ab3b8a7421 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.809822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:30.886803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.887477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.887769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.888052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.888869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:30.889241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.890613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.894419 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d78583-3932-44ec-a742-e69269ae483d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:30.920078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 273/538] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:30.925962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:30.958845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:30.959519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.959805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.960082 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.960918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:30.961232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:30.963809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc878b-087d-4954-994a-38ddeb09386c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:30.978567 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 266/539] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:30.979942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84e5-e49c-4285-bf9c-6526cf33b31d None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:30.980246 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84e5-e49c-4285-bf9c-6526cf33b31d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:30.980533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84e5-e49c-4285-bf9c-6526cf33b31d None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:30.982062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 267/540] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:30.983821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef84e5-e49c-4285-bf9c-6526cf33b31d None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.053253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476e35f-2da3-4851-921e-fc11eaa7fd81 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.065384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.087644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.088311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.088656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.089795 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.090873 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=9f8fddb8437e4b058dc5891c0ef2937b) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:31.091396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:31.093055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a791e-acd1-4890-8a6a-43237c5dee54 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.101398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 274/541] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/role_assignments?user.id=9f8fddb8437e4b058dc5891c0ef2937b&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:31.102869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.103360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.103839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.131225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef84e5-e49c-4285-bf9c-6526cf33b31d None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.146633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:31.150101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.198787 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.212533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.213630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.216232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.216762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.217904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=36fa4087f9e348ea87a4d918a23b5660) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:31.218449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:31.220135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.234159 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 268/542] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:30 2022] GET /identity/v3/role_assignments?user.id=36fa4087f9e348ea87a4d918a23b5660&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:31.277539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 275/543] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:31.306399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.443293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c36dd-c16a-49af-bc75-e9ff104b69dc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.444801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.482568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.483551 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.483983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.484401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.495339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:31.505607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:31.506717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:31.508331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:31.511744 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 269/544] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:31.517587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.621950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319518b2-8185-4397-8a45-782b1a9205ba None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.658198 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.659166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.659631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.660077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.661057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:31.661584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:31.663131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878f52-855c-463e-bc19-34f59e9c8b33 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.672206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 276/545] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:31.677668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.773157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e4a6-0a10-4e4d-97ea-ab4ccdf0be21 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.773871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e4a6-0a10-4e4d-97ea-ab4ccdf0be21 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.774374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539e4a6-0a10-4e4d-97ea-ab4ccdf0be21 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.776199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 277/546] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:31.783151 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.783437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.783718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.793509 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426298d6-512b-45c4-9c83-32fa4eddc231 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:31.815646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:31.816877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:31.844134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.860216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:31.861051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:31.861338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:31.861616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:31.881435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:31.882912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:31.914535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:31.915428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:31.916279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:31.916279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:31.916279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:31.916279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:31.916279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 270/547] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:31.921213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:31.940197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.974350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 278/548] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:31.994958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.056307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e00557-1aa1-4f23-b795-ba621cc5d0fd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.091212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.092147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.092577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.093037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.093909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:32.094453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.095960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.109557 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 271/549] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:32.117526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.193344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c572-ae8b-46f4-b4b5-a03d090eee80 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.243759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.273334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.274136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.274422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.274697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.286649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd31c1-e52e-47d1-871a-51bdd6cd38fe None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.300158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:32.311805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:32.313410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:32.314555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:32.322939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 279/550] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:32.323808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.346938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.363525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.364358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.364645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.364949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.382584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.384030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:32.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:32.408031 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:32.409402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 272/551] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:32.414155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.514296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c943e3f-eed1-4b6e-9dd3-a87e3375de79 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.555065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2e767-8b0f-493c-b93b-a07dace431a7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.568207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.570059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.570597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.571023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.572466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:32.573431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.575245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d4e2-ffcf-4682-bb57-0ddbd5651f28 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.592458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 280/552] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:32.594396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2d98-500e-44a9-b50f-635f11bd1d6b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.594834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2d98-500e-44a9-b50f-635f11bd1d6b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.595296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2d98-500e-44a9-b50f-635f11bd1d6b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.596775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.597619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.597805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 281/553] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:32.598132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.598658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.599132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2d98-500e-44a9-b50f-635f11bd1d6b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.599760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:32.600184 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.602327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c6ae0-8c09-4604-a364-07380ecb88af None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.605347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.633005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 273/554] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:32.634905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.635812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.636531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.657963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:32.659545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:32.679718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.715133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2d98-500e-44a9-b50f-635f11bd1d6b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.750945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.751993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.752439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.752799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.755646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 274/555] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:32.757461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.765491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:32.767099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:32.785302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:32.786253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:32.787102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:32.787102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:32.787102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:32.787102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:32.787102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 282/556] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:32.789441 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:32.892829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4390b-0d2f-462f-892c-4a1ad1a260cf None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.900044 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b19c2-1dfc-4e81-b1eb-99a93fd84d41 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:32.919139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.931100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:32.933345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.934206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.934534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.934825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.946368 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:32.947860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:32.948330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:32.949119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:32.963271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:32.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:32.975440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:32.976717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:32.979863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 283/557] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:32.981233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.009931 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.011610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.114194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578805-3196-420e-8f65-8a1656aefab5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.116661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 275/558] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:33.117753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.142628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.161828 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.162864 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.163172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.163476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.164220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.164532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.166377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.183408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 284/559] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.184406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.229011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286e7cb-b178-453b-a47e-b9e743f552dc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.238775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.269013 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.270116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.270693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.271174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.272273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.272805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.274535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.284271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 276/560] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.285562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.308693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a21d89-a2ec-493b-ae1c-adef614fa566 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.352580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.353455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.354032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.354370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.368788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.370365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.382853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:33.393590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:33.394482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 285/561] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:33.395993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.410087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28ea12-03bd-40d5-b1eb-40d378ab93ec None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.456109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.456109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.456109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.456109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.464504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.466152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:33.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:33.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 277/562] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:33.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.520875 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.530596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def5c25-9610-4582-a54c-2e51303735a0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.568309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.569132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.569418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.569690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.579771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.581254 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.593838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f3bb-362e-47c6-aea4-023b496a1ed8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:33.598659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:33.599551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:33.600427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:33.600427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:33.600427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:33.600427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:33.600427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 286/563] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:33.600709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.627446 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.628109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.628391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.628671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.629432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.629742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.631667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d189ce-96e1-4bf2-af25-30890d3ac386 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.643896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 278/564] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.645144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906ff8-efb0-43d3-9f1c-6ee3c9062374 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.645740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906ff8-efb0-43d3-9f1c-6ee3c9062374 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.645740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906ff8-efb0-43d3-9f1c-6ee3c9062374 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.648657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 279/565] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:33.648657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a12d-3325-45b0-b40b-b8452fcfc8e5 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.648657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a12d-3325-45b0-b40b-b8452fcfc8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.648657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a12d-3325-45b0-b40b-b8452fcfc8e5 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.649896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 280/566] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:33.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a12d-3325-45b0-b40b-b8452fcfc8e5 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.656142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.706848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807c9-ef03-422e-865b-99d733865c8f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.741234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.741908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.742194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.742473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.743317 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.743629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.745092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.754448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a12d-3325-45b0-b40b-b8452fcfc8e5 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.761713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 287/567] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.765853 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.769708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.790120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.790781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.791065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.791344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.792074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:33.792384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.793771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bd59f-31e3-4416-8670-e34224405c1a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.805314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 281/568] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:33.806502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f494-6b97-47e2-a37b-45dda9580597 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.806793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f494-6b97-47e2-a37b-45dda9580597 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.807070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f494-6b97-47e2-a37b-45dda9580597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.822821 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-2f76f494-6b97-47e2-a37b-45dda9580597 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:33.824010 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-2f76f494-6b97-47e2-a37b-45dda9580597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:33.870677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babdcca-a3e8-4007-b1d5-8640fbd8d933 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:33.882102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:33.891416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 282/569] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:33.892672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.893060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.893350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.907777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:33.908571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:33.908880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:33.909159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:33.916431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:33.917952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:33.920759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:33.921971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:33.932429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:33.933409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:33.934276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 288/570] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:33.934765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.989842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 283/571] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:33.990710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:33.996707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.037657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c5935-6c35-4dad-a412-10224c36f2c7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.069417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.070208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.070493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.070771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.081264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.082731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.088668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1858f7-39db-450f-815a-ee18f527c5b7 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:34.101143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:34.102222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:34.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:34.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:34.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:34.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:34.103099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 289/572] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:34.103365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.114738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.126099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.126887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.127174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.127451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.134481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.135935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:34.151284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:34.152328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:34.153751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:34.156995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 284/573] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:34.158321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.202998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c6ed-12ad-49d4-9747-d761f0401c44 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.219116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.239174 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.240019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.240253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.240518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.250527 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:34.257946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea776ad-069e-40f9-a6e6-92975b198f92 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:34.258379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:34.259413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 290/574] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:34.265264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.293704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.294357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.294636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.294905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.295695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.296001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.297455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.308696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 285/575] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.309530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.356238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.366935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5956b6-c87a-41da-8dd0-7533e3046b46 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.400661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.401475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.401766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.402038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.411200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c498df-b288-4330-b39f-f56efbfadce1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.412521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:34.420162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:34.421255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 291/576] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:34.422237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.445326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.445979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.446292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.446574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.447309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.447923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.449046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.461714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 286/577] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.462558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.468420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.534581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70758ee3-bb4d-4ad9-9d1e-dc945de4b565 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.568676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0bc67-450f-4a5c-a6c7-a7c860fe8166 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.569993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.570946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.571351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.571718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.572014 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.573131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.573695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.575271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.597565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 292/578] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.597565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.609364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.610030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.610316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.610621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.611349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.611658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.613332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.621566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 287/579] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.622372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.689719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.698013 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ab9b-69f1-4906-84c7-fd7634135455 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.725962 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6a3f4-fc1b-472e-bce7-efc902c39aba None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.743344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.744354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.745097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.745546 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.746529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=810cd1c21e2d4f379b02b91885be1882) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.749247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.757469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 293/580] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/role_assignments?user.id=810cd1c21e2d4f379b02b91885be1882&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.758437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.764425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.765150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.765442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.765731 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.766522 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:34.766837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.768373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.779852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 288/581] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:34.780964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:34.821106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:34.924656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5697394-f7f2-49e3-8b9c-c88f1ade87b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.941970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598399d-5cdc-47af-9da5-a9d6dca0a2aa None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:34.971373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.972161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.972448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.972736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.980323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.982030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:34.983059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:34.984210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:34.984736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:34.985231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:34.997016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:34.997300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:34.998145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:34.999040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:35.001384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.003355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 294/582] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.004256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:35.023385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.024353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.025231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:35.025231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:35.025231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.025231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:35.031942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 289/583] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.032536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.035122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.123343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.124657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bddc84-7636-4b93-a73a-8e7a1cc120c3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.144106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eb219-1ab5-49b3-aa15-6e3bb943c320 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.163008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.163808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.164094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.164376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.175438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.178515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.182828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.183617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.183900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.184174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.194562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.196011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:35.196460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.197358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.198235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:35.198235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:35.198235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.198235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:35.198235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 295/584] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.198513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:35.219648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 290/585] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.227215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.285473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.319843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa4f27-47f7-4ea2-89a2-db9bec8f76e8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.332303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7cc98-9ab7-4224-954c-76a716e1cbf6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.361908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.362577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.362865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.363145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.363939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.364870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.366067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.366275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.372283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.372984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.373276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.373606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.374303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.374658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.376028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.380011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 296/586] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.390387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 291/587] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.391289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.503467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fda86-855e-4d94-a4ca-dcafa5feca01 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.506478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be4441-8a2e-44f0-88c7-729705ad58ac None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.534663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.541524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.542203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.542491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.542771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.543501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.543809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.545209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.548490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.549586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.549809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.550090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.550833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:35.551146 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.552553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.558484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 297/588] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.559286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.571885 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 292/589] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:35.573633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.633390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.666742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7510a-0abc-41aa-b1bb-c46def24461c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.686001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1435e-5967-4638-8e13-f50eac23198e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.701561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.702536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.702890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.703233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/992d3b61b59d4208be7396a153d6231e/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.719402 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=992d3b61b59d4208be7396a153d6231e, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.720841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.723065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.724596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.725306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.725721 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.733344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.734983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 298/590] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:35 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/992d3b61b59d4208be7396a153d6231e/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:35.735096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.735673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:35.762354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.763312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:35.764652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 293/591] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.765948 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.795460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.882260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d30385-c6ab-4fd9-bd0f-1ec074bcf3e8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.901843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7b22-fd77-4a2b-afa9-178f5db7f58b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:35.919614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:35.924306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.925155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.925493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.925777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.936132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.937806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.951354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:35.952293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:35.952673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:35.953081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:35.955258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.956349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:35.957543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:35.961379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 299/592] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.962321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:35.966990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:35.966990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:35.984897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:35.986927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 294/593] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:35.989733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.076597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.083377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbd42c-5a10-4e27-9ca0-483c6107f062 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.119234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.119930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.120214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.120491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.121324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.121632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.123135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.126658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd68037-8fe9-488e-a19f-33af330032c5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.140890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 300/594] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.141818 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.176965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.178450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.179363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.180962 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.182029 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.182589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.184214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.209307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 295/595] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.210020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.242776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.266544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e05f4-7d57-40dc-b124-543e93911605 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.306144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.307305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.307813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.308289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.309468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.310107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.311734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.315584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9857-7605-4acb-b959-06f5a1f1f63c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.332580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 301/596] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.333779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.355290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.356188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.356463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.356737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.358752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.374325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=861c2da914694e319257102a0fd2f19f, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.375824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.397314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 296/597] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:36 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:36.398447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.457511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ca4f-fe2b-42b0-8625-b2c721ff7723 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.499745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.501058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.501553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.502090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.515399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.517307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:36.537934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:36.538874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:36.539748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:36.539748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:36.539748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:36.539748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:36.542535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 302/598] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:36.550815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.617116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.643868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d60ba-8f12-42d2-ad2e-426c3c54dd68 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.645334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.682027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b286d7-f526-44d7-b751-98bd0daaf4a0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.686258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.687068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.687357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.687638 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.699012 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.700553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:36.719639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:36.720541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:36.721455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:36.721455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:36.721455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:36.721455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:36.721455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 297/599] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:36.725809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.726500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.726786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.727063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.727868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.728184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.729762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.734354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.758616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 303/600] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:36.765833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.872481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c34fb-eb19-4dd5-9e48-70a9e28e9f61 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.901996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.907800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.908585 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.908930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.909509 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.910512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:36.911596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.913087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd80e3-cb7a-40d4-9deb-1febf696574c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:36.925658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 298/601] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:36.927692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780978-1d46-4436-8637-0f79561275df None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.932332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e578-07d0-4af8-b43f-3c1bcddf3d70 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:36.932577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780978-1d46-4436-8637-0f79561275df None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.933000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780978-1d46-4436-8637-0f79561275df None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.934676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 299/602] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:36.939133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66780978-1d46-4436-8637-0f79561275df None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:36.976952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:36.983218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:36.984339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:36.984807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:36.985203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:36.993172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:36.994740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b55be523-320a-43a0-a2ad-5e91b37939b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:37.009680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:37.010625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:37.011486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:37.015841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 304/603] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:37.017249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.017604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.017997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.041932 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:37.043730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:37.066274 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66780978-1d46-4436-8637-0f79561275df None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.104823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.105834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.106122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.106469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.113754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.115340 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:37.129561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:37.130477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:37.131357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:37.135673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 300/604] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:37.136678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.144069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 305/605] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:37.144069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.225053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.267296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8783b-b96d-4ad0-a035-130e2f0526b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.290279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.293499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee50e-8262-496c-ab60-c78868da57c2 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.305526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.306379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.306725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.307098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.307990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:37.308492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.310010 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.327667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 306/606] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.328703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.338455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.339245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.339625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.339996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.341124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:37.341473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.342973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.361133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 301/607] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.362824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.463613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977bc58-a17d-46e6-9f62-97423857b8e5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.472863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442f331-6e1e-45bd-af31-30212595fabb None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.491064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.505204 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.506265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.506648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.507138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.515114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.516315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.516809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.517364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/36fa4087f9e348ea87a4d918a23b5660/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.519367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:37.528706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:37.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:37.530604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:37.535278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 307/608] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:37.536447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.537358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=36fa4087f9e348ea87a4d918a23b5660, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.538988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.556595 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 302/609] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:37 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/36fa4087f9e348ea87a4d918a23b5660/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:37.557869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.606386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.677182 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9d5b7-b05b-4813-a77f-4d4e69780ad8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.717415 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.717921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12737f52-1930-40d3-9316-cede0bd0f93f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.718970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.719534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.719990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.721083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:37.721676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.724007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.734371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 303/610] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:37.762606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:37.780830 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.781697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.781981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.782261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/9f8fddb8437e4b058dc5891c0ef2937b/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.802883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:37.826475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=9f8fddb8437e4b058dc5891c0ef2937b, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.827949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf16aca-bea1-4b3c-9364-df35928c66f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.853422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 308/611] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:37 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/9f8fddb8437e4b058dc5891c0ef2937b/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:37.913225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde1f3-b592-47b6-af74-9ef04eba07ac None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:37.952801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:37.953637 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.953922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.954195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.963107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2d48-a777-4694-bbe5-1c04dc7466df None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.963569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2d48-a777-4694-bbe5-1c04dc7466df None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.963859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa2d48-a777-4694-bbe5-1c04dc7466df None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.965411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 309/612] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:37.973485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:37.974100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:37.974314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:37.974801 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:37.975799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:37.992769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:37.994337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:37.995955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:37.996909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:37.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:37.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:37.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:37.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:37.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 304/613] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:38.003249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.097208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 310/614] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:38.117724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.119197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.147217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c62ae-6aab-4b3e-9361-3724177e4945 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.157709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.197371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.198146 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.198503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.198872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.199684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:38.200066 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.201548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.214360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 305/615] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:38.224489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.260306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90007b8e-ec52-4838-9d03-988c6ca37805 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.296841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.297714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.297998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.298321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.310260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:38.318344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:38.319302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:38.320152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 311/616] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:38.325310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.352738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531b33-141f-45da-adc4-54bf7070c491 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.391865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.393110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.393619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.394110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.398293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.404516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.406370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:38.423860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:38.424906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:38.425845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:38.429179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 306/617] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:38.434948 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.557755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d7ed1-6c79-497c-b759-9365a4ebc081 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.599978 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.601732 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.602255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.602728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.603850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:38.604373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.606648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.623433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.627704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 307/618] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.633805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.686764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32662-2173-46c8-b270-cd516f740388 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:38.751777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d7c2-9c6a-46ae-adfe-7dce63b69ae5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.764447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.765156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.765439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.765713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.766480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:38.766787 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.768431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03558e46-0f91-4f7e-af70-fb184992ee9b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.788882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 312/619] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:38.790378 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af360f7-e57f-4ec4-8e5f-88765e2a07b8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.790672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af360f7-e57f-4ec4-8e5f-88765e2a07b8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.790969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af360f7-e57f-4ec4-8e5f-88765e2a07b8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.793365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.794404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.794896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.795377 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.796845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 313/620] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:38.797644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af360f7-e57f-4ec4-8e5f-88765e2a07b8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.811276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.812755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-461bd06e-5433-42d1-a5ba-4d2f968124f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:38.838228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:38.839196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:38.840068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:38.840068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:38.840068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:38.840068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:38.840068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 308/621] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:38.845105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.846212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.847937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.866278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:38.867761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:38.919467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af360f7-e57f-4ec4-8e5f-88765e2a07b8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:38.949374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 309/622] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:38.950977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:38.954844 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:38.955937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:38.956066 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:38.956299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:38.980735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:38.983484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:38.986916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.012227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:39.013507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.014365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.015228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:39.015228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:39.015228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:39.015228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:39.021376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 314/623] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.022110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.090933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a7d3f-cdbb-4bed-84ca-046d8392dd8e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.126065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e777d-a353-45ac-a40b-e60c8272b463 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.128367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.129316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.130330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.130871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.131852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:39.132377 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.134071 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.147587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 310/624] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.148759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.167044 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.167843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.168130 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.168406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.178970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:39.186943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.187872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:39.188696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:39.193665 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 315/625] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.194504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.251534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.260539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.268693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc41b6-992d-44df-8c7e-13f161caebbf None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.304875 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450aed-2a66-4f67-bdbb-2fff1122e6c9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.307884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.308784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.309308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.309794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.310740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:39.311258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.312957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.330956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 311/626] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.332277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.339663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.340462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.340745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.341207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.348335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.350240 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:39.364522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.365509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:39.366388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:39.370701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 316/627] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.371544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.450787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879d4b0-0d10-41e8-8470-84b027f8c988 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.480207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a30f-f553-4587-b667-21509e0e3669 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.491581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.492642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.493184 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.493707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.494695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:39.495203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.497028 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.498219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.509407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 312/628] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.510630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.523262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.524303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.524303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.524596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.532961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.534204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.534385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:39.549913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.550916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:26:39.551870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:39.555868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 317/629] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.556653 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.630837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3d251-bb4f-41db-9621-181da5a0bfca None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.659563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752992a-5b5f-419d-ae52-53621d2bf9cc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.667810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.668795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.669338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.669815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.670833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:39.671441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.673125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.687593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 313/630] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.688714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.700105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.700981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.701209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.701480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.711825 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.713481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:39.732105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:39.733059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:39.733946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:39.733946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:39.733946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:39.733946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:39.738051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 318/631] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:39.739426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.769244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.777698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:39.803528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4138d2-8060-484c-bf15-8074e259ffcf None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.839108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.840145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.840640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.841160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.841424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399c73d-93a6-4e76-a95b-ae3862464df6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:39.842505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:39.843083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.844705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.865340 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 314/632] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:39.866564 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.882463 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:39.883374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:39.883695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:39.883975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/810cd1c21e2d4f379b02b91885be1882/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:39.899861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=810cd1c21e2d4f379b02b91885be1882, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:39.901337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:39.925096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 319/633] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:39 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/810cd1c21e2d4f379b02b91885be1882/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:39.928609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:39.984497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccabc8-9a86-44d3-9e55-743acbce0106 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.026960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.028114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.028527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.029010 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.029913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:40.030332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.031837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff4a3-ce26-43e5-bc9c-078f2b71bba5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.035227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.037348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.049899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 315/634] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:40.051739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8314-16d2-440a-9f4e-ede924d31f0a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.052168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8314-16d2-440a-9f4e-ede924d31f0a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.052554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8314-16d2-440a-9f4e-ede924d31f0a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.059577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 316/635] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:40.059577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8314-16d2-440a-9f4e-ede924d31f0a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.078777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caa6ef-6f9d-49d9-abc6-efb0ad9d8602 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.119922 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.120907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.121175 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.121459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.183796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8314-16d2-440a-9f4e-ede924d31f0a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.196484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.198050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.231069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.232015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.232302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.232837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.242598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.244537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-1f4b34bc-302b-4a2b-a7cc-f98277c8f65b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:40.264411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:40.265607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:40.266763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 317/636] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:40.267495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.267495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.269764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.291272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.291467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:40.293101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:40.324409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 320/637] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:40.325329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.369871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.397006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 318/638] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:40.398804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.435897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67541000-e274-4bc4-84dc-4bc5c4bec120 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.483411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.484315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.485155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.485552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.486295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:40.486608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.488039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96c937-8956-4cd1-9c10-acf83547c585 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.512965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 321/639] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:40.513135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd738-8734-4a52-8730-b24a85a1c1e2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.513219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021504a-b6cd-46df-8790-ab4b5b9d2a5c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.513219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021504a-b6cd-46df-8790-ab4b5b9d2a5c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.513219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021504a-b6cd-46df-8790-ab4b5b9d2a5c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.513219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 322/640] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:40.513219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021504a-b6cd-46df-8790-ab4b5b9d2a5c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.550334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.559037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.559829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.560114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.560645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.571321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.572773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:40.590514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:40.591379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:40.592234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:40.592234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:40.592234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:40.592234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:40.596627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 319/641] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:40.597092 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.622804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021504a-b6cd-46df-8790-ab4b5b9d2a5c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.639175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.659313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.660231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.660519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.661345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.671279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ce8c7401-f5d8-48ad-a07c-82ad652e3120 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:40.681253 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:40.682285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:40.683159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 323/642] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:40.683861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.684282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.684282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.702732 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:40.703996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:40.708793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f45f-b1aa-4df7-becf-da0cb7724542 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.746493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.747150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.747439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.747719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.788963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 324/643] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:40.788963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.812778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.830411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.832018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.876480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:40.893526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7516d-4f80-4b8f-af70-50ca8d06515a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:40.930879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:40.931545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:40.931834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:40.932114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:40.932870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:40.933188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:40.934565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:40.942607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 320/644] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:40.943369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:40.954636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 325/645] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:40.954636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.043563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.054636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3b1d-87ec-4c34-a2fd-147b761804ff None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.061185 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8dc38-8d9c-4c9c-8bc2-b879f41f11d9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.089860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.090554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.090839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.091119 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.092007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.092317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.093712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.099224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.099715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.101340 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.101676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.101989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.103984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 321/646] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.104952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.118689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:41.126893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.127886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:41.128889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 326/647] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.130167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.215764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c68d4-cc84-47ff-a559-cb18822bd981 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.238845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd270d0-9d78-43fc-b489-ab41b528416d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.249105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.249896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.250179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.250456 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.260839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.262308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.274978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.275899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.276248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.276640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:41.280105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.281200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.282217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:41.282217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:41.282217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.282217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:41.285128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.286573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 322/648] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.286573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.286761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:41.301723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.302600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:41.303495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 327/649] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.303988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.308223 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.348244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.401155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d847e1-ef84-4040-a2de-a6d749bd9727 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.408130 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60658bc-4c97-4e5b-8fc7-db491a69400a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.436649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.437474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.437870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.438151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.443656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.444325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.444608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.444907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.445666 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.445976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.447347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.450469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.452143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.460903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 328/650] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.461740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:41.477589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.478510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.480110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:41.480110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:41.480110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.480110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:41.481755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 323/651] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.482694 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.547258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.586220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb388-9317-4248-a939-7e8b946e6590 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.600462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fe7d1-85e2-4856-bfb7-265f6c75de58 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.603631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.621342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.622098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.622391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.622671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.623403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.623714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.625091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.642308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 329/652] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.642308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.642565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.642565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.642565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.642565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.642843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.643018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.644546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.657138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 324/653] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.657946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.752393 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1cf33-2d7e-45fb-830f-c4238faa703c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.769886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1635-0d47-4459-9c8b-a62f006c53fd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.781201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.791070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.791867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.792153 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.792428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.802828 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.804270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.811503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.812358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.813167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.813744 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.814812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.815272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.816811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:41.821903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:41.822970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:41.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:41.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:41.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:41.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:41.823867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 330/654] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:41.824319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.834306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 325/655] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:41.835203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:41.864512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:41.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c814d-696a-45ac-8bef-68dbc63d2fba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.944386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd0bcd-202d-4d1e-8813-e58b276c01d6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:41.976190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.977014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.977304 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.977585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.981554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:41.982210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:41.982499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:41.982779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:41.983622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=992d3b61b59d4208be7396a153d6231e) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:41.983940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.984516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:41.985410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:41.985979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.000886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 326/656] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/role_assignments?user.id=992d3b61b59d4208be7396a153d6231e&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.000886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:42.011299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.012255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:42.013179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 331/657] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:42.013667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.066723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.109062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.122284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9584b6-42e1-437a-a42b-b7567ed176d5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.140289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc6ea-6ec6-445a-b59b-b6e9d9c9a790 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.160149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.160966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.161258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.161541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.162494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.162599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.164038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.178081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 327/658] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.178767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.185075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.185886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.186177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.186455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.195495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.196982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-13a078bb-15f2-41ec-800b-826f37141563 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:42.213779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.214954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:42.216068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 332/659] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:42.217231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6f6f-7a13-4b37-98be-df25565fbcb0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.217517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6f6f-7a13-4b37-98be-df25565fbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.217800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6f6f-7a13-4b37-98be-df25565fbcb0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.219233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 333/660] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:42.219755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6f6f-7a13-4b37-98be-df25565fbcb0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.292782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca86d7-a432-4b3f-a4c5-1a8fca18a221 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.329652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.333069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.333737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.334021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.334294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.335090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.335396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.336295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6f6f-7a13-4b37-98be-df25565fbcb0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.336815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.349112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 328/661] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.349940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.362137 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.380518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.381283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.381562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.381835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.389929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.391375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9a55c605-ca54-4552-804f-588993d3df38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:42.406462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.407428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:42.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 334/662] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:42.409596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872104-635b-4302-b985-fec55e4154a7 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.409596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872104-635b-4302-b985-fec55e4154a7 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.409596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872104-635b-4302-b985-fec55e4154a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.428108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-07872104-635b-4302-b985-fec55e4154a7 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:42.429312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07872104-635b-4302-b985-fec55e4154a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:42.471542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d95a08-1ef1-4f5c-b5ae-87d1b6058263 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.501083 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 335/663] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:42.508380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07872104-635b-4302-b985-fec55e4154a7 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.518922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.519775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.520286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.521830 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.522287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.523952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.548775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 329/664] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.549917 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.621121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.621531 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.637589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07872104-635b-4302-b985-fec55e4154a7 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.667315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ebd49-8889-4ca8-97cf-cbc597175fbf None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.674862 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.675522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.675807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.676089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.677530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.677844 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.679268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.685153 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 336/665] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.686040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.716136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.717217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.717716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.718231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.719514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:42.720039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:42.722015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:42.748820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 330/666] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:42.750041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.818979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10972416-ff40-4759-8a81-0223512fba96 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.862457 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e9e6-1928-482a-919c-d30a14d15fe0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:42.872398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.873952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.874380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.875128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.891438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:42.891926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:42.902180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:42.903458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:42.904273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:42.906810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 337/667] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:42.906917 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:42.907514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:42.907904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:42.908193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:42.908491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:42.924367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.007222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.008680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.030328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cefd2-a31f-4a88-9f62-730db709db9b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.074708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.075371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.075661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.075943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.139679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 331/668] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:43.140649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.153809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.155474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.169325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.179545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.255935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb0cec-4771-4577-84f1-a51cce41e94e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.279305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 338/669] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:43.280406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.292652 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.293462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.293753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.294034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:43.295167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.296690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.306555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 332/670] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:43.307557 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.388426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed29ee0-733a-4bc7-bc7d-2c43a38b9194 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.400958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.404489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.416826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea7af-86cd-453f-ab46-0d71def15fc4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.433229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.434320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.434792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.435233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.446785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.448390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.451500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.452293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.452578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.452878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.467771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.469259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:43.471053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:43.472092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:43.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:43.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:43.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:43.482708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 339/671] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:43.484241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:43.489569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:43.490589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 333/672] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:43.491548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.597088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6608cd-f348-497a-bfed-dc073f6eded6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.600974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25715dfb-65d6-4c6b-a3d7-dcca97fdb7d4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.636371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.637086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.637753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.638039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.638143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.638303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.638933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.639046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:43.639336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.639707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.640698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.647880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.652510 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.658826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 334/673] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:43.658826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.659764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:43.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:43.683623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:43.684475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:43.684475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:43.684475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:43.684475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:43.686423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 340/674] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:43.687389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.705946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.767473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe046c-2326-4e92-8042-36ebc0d9f7e3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.791698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408b121-eaa9-42d7-a655-da7198684ede None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.805738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.806542 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.806775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.807057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.807802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:43.808435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.809718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.822653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 335/675] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:43.823613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.829892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.831364 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.831845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.832313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.840211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.842032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:43.856605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:43.857524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:43.858397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:43.865341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 341/676] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:43.866511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:43.886985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.934621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2d3b-98f1-493c-b25c-3631fbbcfdb1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.947034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:43.976265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568097b8-6a2c-4f91-8f5b-16f474c4b5dd None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:43.979063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:43.979912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:43.980343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:43.980762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:43.981681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:43.982135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:43.983630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:43.997516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 336/677] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:43.998679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.016547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.017731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.018112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.018489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.027041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.028970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:44.047833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:44.048796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:44.049855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 342/678] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:44.051166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.131539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f37-a60e-4854-8f48-1ffe16adc2d1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.155643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.173324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08183a76-c1b7-490e-94f0-c1b207f6a674 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.176790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.177392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.177674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.177953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.178740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.179049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.180455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.197916 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 337/679] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.198719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.215974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.216766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.217082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.217363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.220564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.226074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.227520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5dd32583-0e8d-49b9-a5df-1692d446168f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:44.248343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:44.256029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 343/680] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f96a3-a2a0-4b7d-91ad-cdabe0886448 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.258052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f96a3-a2a0-4b7d-91ad-cdabe0886448 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.259148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f96a3-a2a0-4b7d-91ad-cdabe0886448 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.259148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 344/681] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:44.259148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f96a3-a2a0-4b7d-91ad-cdabe0886448 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.311346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd269377-11e0-41ad-9bd1-16f6d5847556 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.347282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.347946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.348229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.348816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.349326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.349638 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.351063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.368235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 338/682] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.368235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.374114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f96a3-a2a0-4b7d-91ad-cdabe0886448 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.408527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.416342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.417088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.417323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.417599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=36fa4087f9e348ea87a4d918a23b5660) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.418761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.420180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0609101-c502-4acd-8e3e-b9a2fd66907f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.427508 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 345/683] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/role_assignments?user.id=36fa4087f9e348ea87a4d918a23b5660&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.428523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.428812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.429112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.447523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:44.448894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:44.489155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f616e-8afd-4607-b79b-5961667cdb48 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.517132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.531505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.532661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.533223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.533709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.534790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.535312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.537313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 346/684] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:44.537599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.538343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.559181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 339/685] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.569054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.683128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8625-4b8b-418c-b888-2288237ba4b9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.692413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.701432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cda9c-97ba-42ba-a90a-d49fed575366 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.721929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.722748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.723626 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.724016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.725294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=9f8fddb8437e4b058dc5891c0ef2937b) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:44.725715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.727786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.735923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 347/686] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/role_assignments?user.id=9f8fddb8437e4b058dc5891c0ef2937b&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:44.736991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:44.745616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.746292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.746701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.746981 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.845352 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:44.901787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.905301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b13f-1e77-4c79-b99a-cfdd050f4acc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:44.932620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c2182-c2de-4dd4-b68d-f058c1c239d5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:44.978740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:44.980042 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:44.980330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:44.980610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:44.996155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:44.997649 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b7087102-e223-4f3c-9297-1ec5e32503e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:45.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:45.017850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:45.018914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:45.018914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:45.018914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.018914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:45.018914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 348/687] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:45.019638 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2c82-ed9b-453d-acbf-6db004cee2f6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.020553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2c82-ed9b-453d-acbf-6db004cee2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.020769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2c82-ed9b-453d-acbf-6db004cee2f6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.022204 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 349/688] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:45.025712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e2c82-ed9b-453d-acbf-6db004cee2f6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.034661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.045253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 340/689] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:26:45.045253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.045253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.045253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.063963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:45.065308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:45.148454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 341/690] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:45.149385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.163676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e2c82-ed9b-453d-acbf-6db004cee2f6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.171642 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.220886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.221584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.221871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.222149 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.223184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:45.224100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.225799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.242958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 350/691] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.244239 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.262698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ab116-b52f-4c17-a451-3a46f7130779 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.290554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.303656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.304801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.305446 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.306594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.323058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.325505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:45.351766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:45.352951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:45.353857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:45.353857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:45.353857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.353857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:45.360980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 342/692] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:45.360980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.384794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8602-682a-4e3d-aa2b-9035c14acded None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.437994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.438741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.439021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.439549 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.462279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:45.476243 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2896e0e-76f4-48cb-9df5-83607e6a6437 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:45.477811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:45.478813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:45.479713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:45.487949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 351/693] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:45.489526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.517423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.518239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.518616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.519013 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.519989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.521828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.527075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.546279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 343/694] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:26:45 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:45.547334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.588773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.648313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c7ef-0e7b-44ef-8a10-bf897a2b95dc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.672903 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05ad6d-6067-47f0-bfbe-64ce0f50442e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.706104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.706994 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.707416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.707787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.708710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:45.709216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.710885 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.721604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 344/695] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.728442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.742765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.743445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.743723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.743995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.744735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:45.745062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.746496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.775456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 352/696] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:45.781267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.890875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.900670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e379f7-3546-4eb2-a912-569b2ea7ba6d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.909942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:45.934554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e047612-5cce-43b6-84e3-1fa9bd44e48f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:45.944613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.945578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.945963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.946335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.961408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:45.963746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:45.985548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:45.986646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:45.986763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:45.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:45.988482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:45.988482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:45.988482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:45.988482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:45.988482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 345/697] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:45.989960 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:45.990396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:45.995070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:45.998687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.001280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:46.018931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:46.020395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:46.021294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:46.024407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 353/698] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:46.031321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.116525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acd934-dde1-4dfa-9971-4b41a35071ed None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.139024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602140d7-9d99-4994-8242-54cf6222e625 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.154118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.155016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.155481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.155925 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.156975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.157474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.159083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.173518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 346/699] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:46.178645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.180457 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.181143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.181421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.181689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.182481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.182806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.185523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.191986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.199317 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 354/700] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:46.204880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.215220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.319344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8a513-3243-495c-bf67-ce36507e3965 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.356081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.357007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.357358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.357705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.358616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=810cd1c21e2d4f379b02b91885be1882) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.359097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.360522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.367121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 355/701] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/role_assignments?user.id=810cd1c21e2d4f379b02b91885be1882&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:46.378117 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2d7ce-4b61-4ff4-a32c-2e93e92a7e3a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.416518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.417351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.417639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.417921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.426972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.428459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:46.444385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:46.445450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:46.446373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 347/702] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:46.451578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.590539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.631847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29744b-a293-4f27-8293-a07e579faa2c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.668909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.669591 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.669879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.670211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.671064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:46.671379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.672803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7d1d4-88b9-4a06-a11f-bd3c1ce24c53 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.696308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 356/703] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:46.701469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:46.773681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:46.810060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33107c-348e-42c5-bf7a-b4c81862193b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:46.852687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:46.853300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.853590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.853873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.874096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf865a5-08be-41fb-a597-30a5d9e2a8dc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.874394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf865a5-08be-41fb-a597-30a5d9e2a8dc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.874668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf865a5-08be-41fb-a597-30a5d9e2a8dc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.876342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 357/704] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:46.881714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:46.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:46.882758 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:46.905455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:46.906737 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:46.936830 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:46.939116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:46.992892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 358/705] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:47.031420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.032185 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.077875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 348/706] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:47.084110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.156095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.230187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0e9da-691d-4b68-9082-14da9e9fbdf5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.249576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538e200-2121-46cc-b399-0598bfcaae01 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.282936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.284186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.284488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.285977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.287755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.289918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.290893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.291351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.291776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.303403 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.305116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-985dba21-6d1b-4dc2-8e6f-bb8bf9498f9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:47.305400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:47.306589 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:47.307644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.309289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 359/707] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:47.314278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424120-0fa8-4df9-9666-f5a1ee50273a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.314640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424120-0fa8-4df9-9666-f5a1ee50273a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.314989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06424120-0fa8-4df9-9666-f5a1ee50273a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.320944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 360/708] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:47.320944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424120-0fa8-4df9-9666-f5a1ee50273a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-725be77a-1143-44f3-a31a-bcb609fef6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:47.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:47.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:47.336259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:47.336259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:47.336259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:47.336259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:47.342321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 349/709] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:47.343788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.344251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.344680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.361824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:47.363276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:47.378492 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.435767 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06424120-0fa8-4df9-9666-f5a1ee50273a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.440975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 350/710] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:47.442433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.487686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.501986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.502800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.503188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.503469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.504744 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:47.505079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.506622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.516042 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 361/711] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:47.517026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.545737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e95f-e1d0-493c-b934-4052a92cf3ec None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.582099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.583395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.583753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.584100 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.584933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:47.585312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.586764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.603607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 351/712] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:47.604591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.617920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.629408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f57ac8-a913-44c7-9c49-89bc852b5586 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.667584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.668669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.669245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.669697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.670602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.672075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:47.685347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:47.686471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:47.687571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.694850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 362/713] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:47.695970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.711875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be744490-57fe-4619-8534-8d5ff41d184a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.753936 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.754981 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.755900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.756323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.757491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:47.757943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.760138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.769205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.773062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 352/714] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:47.775565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.843764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2eae-68fe-4d1c-bdd1-bad6271e34b8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:47.913097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:47.914273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:47.914794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:47.915298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:47.926697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:47.928533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:47.930581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:47.951357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:47.952333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:47.953280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:47.961010 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 363/715] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:47.966760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:47.986023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae3722-8df2-41d8-a654-0c620b1640a4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.028260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.028736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.029069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.029357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.031319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:48.031643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:48.033219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:48.039350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 353/716] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:48.049393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:48.116374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce4ef-c9da-4f3a-80d1-8fcae29da6c0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.130074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:48.157807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.158761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.159044 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.159909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:48.160156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:48.161816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:48.177684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fdbbe-2e5a-4477-886b-67cff59f71be None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.179904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 364/717] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:48.181324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:48.217708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.218732 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.219266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.219736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.220661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:48.221190 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:48.222776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d155d-5487-46d9-9b86-8406a8b412cc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:48.228165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 354/718] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:48.237080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd864-6837-48d0-9aef-176ddb705548 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.237662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd864-6837-48d0-9aef-176ddb705548 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.237944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd864-6837-48d0-9aef-176ddb705548 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.239975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 355/719] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:48.246047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.246677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.247186 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.262286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:48.267973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:48.269235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:48.377693 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 356/720] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:26:48.391149 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fffa67-28c5-43a5-8bf7-550b55d36abe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.412907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:48.432403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.433545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.434092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.434577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.435619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:48.436129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:48.437896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:48.445351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 365/721] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:48 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:48.556979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a92b8-820f-4a2b-8ec6-0f46a8937f6a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.607010 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:48.614389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.615128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.615418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.615681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.637521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:48.646489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:48.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:48.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 357/722] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:48.655867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:48.705211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:48.790053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68b10-3511-45f0-af4d-54972b416972 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:48.828690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:48.829406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:48.829696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:48.829983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:48.830752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:48.831065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:48.832466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:48.841951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 366/723] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:48.846979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:48.997653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac629e84-7387-4ccc-b138-6b6e9f3425af None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.048109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.048845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.049228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.049510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.067460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:49.069045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-594eca62-ddbe-47d2-9be7-a06aecb20d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:49.088958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:49.089896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:49.090858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:49.090858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:49.090858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:49.090858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:49.090858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 358/724] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:49.098807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.221763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b027995-a202-415b-b8b6-ff2c29b70521 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.225053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:49.259380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.260056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.260344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.260626 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.261396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:49.261707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:49.263090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:49.270639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fce7-c2a1-4b27-9b06-15ecbca99ac3 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.271229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fce7-c2a1-4b27-9b06-15ecbca99ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.271711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3fce7-c2a1-4b27-9b06-15ecbca99ac3 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.273623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 359/725] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:49.276739 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 367/726] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:49.279566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.279923 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.280271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.286554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.308834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:49.310387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:49.393402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:49.396087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2473-1b29-4ee6-ae0b-2f30f5c371a9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.439440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 360/727] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:49.442311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.443440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.443990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.444448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.452976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:49.454895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:49.471282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:49.472265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:26:49.473349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:49.480165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.481041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 368/728] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:49.482505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.513243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:49.596116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dc926-c556-447d-9192-cba9f61b5299 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.632607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.633660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.635027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.635551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.637386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:49.639276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:49.642366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:49.651349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be27cf7-99ac-46d8-8ec6-1ac463b23137 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.684967 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 369/729] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:49.688532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.735265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.736495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.737022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.737518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.762188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:49.778332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:49.779342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:49.780163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:49.786975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 361/730] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:49.790355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:49.860758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:49.861199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:49.898194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc554-2016-4bef-8b05-5f00af35e054 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:49.969228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:49.969890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:49.970179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:49.970532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:49.992253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2828df1-976b-4c36-a30d-a19c751b85b5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.060480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.061179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.061473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.061752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.062517 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:50.062834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.064276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.087610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 362/731] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:50.093839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.098860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.100387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.201327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 370/732] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 14:26:50.212169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.257207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a56fd8-e815-43cb-9cbb-ccb3e4a6f2d5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.261149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.305908 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.309330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.309850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.310331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.330756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.333199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-1bd60539-eb82-4c25-a961-24b98d07e17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:50.351723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:50.352671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:50.353598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:50.353598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:50.353598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:50.353598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:50.355803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 363/733] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:50.361887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f63a0-19ff-4a0a-8a72-ce8777ecd576 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.362260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f63a0-19ff-4a0a-8a72-ce8777ecd576 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.362620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f63a0-19ff-4a0a-8a72-ce8777ecd576 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.364370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 364/734] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:50.365209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f63a0-19ff-4a0a-8a72-ce8777ecd576 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.368668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542d672-04d5-4719-ba97-448dd401fc48 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.412647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.413479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.414197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.414501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.427894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.430717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9c4f1520-1b80-49b1-bb56-511c533fb96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:50.452633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:50.453582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:50.454475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:50.454475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:50.454475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:50.454475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:50.456743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 371/735] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:50.458785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.459306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.459784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.479973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:50.481491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:50.491432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f63a0-19ff-4a0a-8a72-ce8777ecd576 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.505465 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.544540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.545248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.545541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.545824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.546848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:50.547169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.548820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.560650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 372/736] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:50.561852 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.564926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 365/737] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:50.569492 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.593802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.689473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e05ac-7636-40a3-858a-9f2b61a75828 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.719503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbedf16-36a3-4e2b-9bb4-bda6e0017066 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.730154 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.730889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.732896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.732896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.732896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:50.732896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.733878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.748909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 373/738] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:50.748909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.763480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.764279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.764566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.764865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.767653 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.774187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.775647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f0ff6f36-e1d4-4f97-a86e-7b2f1aa8c704 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:50.791310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:50.792304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 366/739] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bdb6-a296-43c0-b5b6-2fe498bfcca4 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bdb6-a296-43c0-b5b6-2fe498bfcca4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.799057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bdb6-a296-43c0-b5b6-2fe498bfcca4 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.799057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 367/740] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:50.799057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bdb6-a296-43c0-b5b6-2fe498bfcca4 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.865595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5398d-97c2-4e00-82b9-535e433b67db None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.870256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:50.901688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.902747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.903010 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.903292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.904017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.905432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:50.915424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bdb6-a296-43c0-b5b6-2fe498bfcca4 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:50.932883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 374/741] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:26:50 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:50.932883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:50.974112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:50.974942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:50.975316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:50.976220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:50.984520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:50.986244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-4b8dd385-ddbb-4037-9c56-dcaf0271af87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:51.002718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:51.003712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 368/742] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e31ca-5cce-40cf-8a83-5e879b780b9d None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e31ca-5cce-40cf-8a83-5e879b780b9d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.006452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e31ca-5cce-40cf-8a83-5e879b780b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.023475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.026430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-ce7e31ca-5cce-40cf-8a83-5e879b780b9d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:51.027963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-ce7e31ca-5cce-40cf-8a83-5e879b780b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:51.056974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f92e98-789c-428d-a118-925bd433372a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.099879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.100563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.100881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.101162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.102029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:51.102345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.103794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d731f-60e1-4443-8759-a062e76ffe29 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.110141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 369/743] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:51.111317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5fc4-c137-480b-a00c-ce15a900593a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.111676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5fc4-c137-480b-a00c-ce15a900593a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.111947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5fc4-c137-480b-a00c-ce15a900593a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.116602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 370/744] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:51.116602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc5fc4-c137-480b-a00c-ce15a900593a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.133565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 375/745] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:26:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:51.135757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628782-8f18-4040-87cf-96969b100064 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.136061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628782-8f18-4040-87cf-96969b100064 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.136343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628782-8f18-4040-87cf-96969b100064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.153872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a0628782-8f18-4040-87cf-96969b100064 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:51.155092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a0628782-8f18-4040-87cf-96969b100064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:51.236898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 376/746] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:26:51.236898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628782-8f18-4040-87cf-96969b100064 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.297946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.307095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.349662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc5fc4-c137-480b-a00c-ce15a900593a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.356327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628782-8f18-4040-87cf-96969b100064 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.385529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.386289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.386573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.386849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.387653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:51.388211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.389439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.393033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.393706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.393996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.394275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.395038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.396400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.402753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 371/747] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:51.403882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.412376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 377/748] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:26:51 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:51.413568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.555597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05120c3-af55-4d23-bce0-765079532ece None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.568874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985bcc-e92d-4f88-9cf1-fca3b6e67c3b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.580526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.590491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.597230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.597957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.598241 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.598516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.606197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.607250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.607714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.608199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.621132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:51.629774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:51.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:51.631524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:51.634357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 378/749] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:51.635382 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.685800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.687346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.779779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cd3b-fb13-42c8-9d4b-eac01f4f5e55 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:51.792829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 372/750] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:26:51.793616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.809934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.830018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:51.832095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:51.832583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:51.833101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:51.834138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=22a8f4b7fb6e4783aac4f34e57ec19fc) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:51.834663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:51.836285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:51.845387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 379/751] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/role_assignments?user.id=22a8f4b7fb6e4783aac4f34e57ec19fc&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:51.846664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:51.904030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:51.998979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca60b10-0289-4757-8a19-7c00c8d0d7ba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.011059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97837-9601-4541-9e62-a10632fcbb71 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.059423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.060282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.060511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.060785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.074323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.075792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.077922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.078601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.078889 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.079166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.079929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.080237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.081734 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:52.101928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.102870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.104384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:52.104384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:52.104384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.104384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:52.104603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 373/752] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:52.106454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 380/753] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:52.108494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.112205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.258067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.269134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f661-d1ea-41ae-8e96-9ce7005faa5a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.292018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.336260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af717c-a5a9-4575-9c3f-c70d0d3ea0c3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.341370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.342341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.343144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.345263 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.346038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.346353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.348309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.372629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 381/754] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:52.378183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.399831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.401056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.401553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.402032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.415444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.417185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:52.436781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.437697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.438569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:52.438569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:52.438569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:52.438569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:52.441603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 374/755] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:52.446534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.556045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d54b9-e510-4478-9a8d-8fa31e6753f3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.584195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.593692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.594673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.595244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.595727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.596618 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b41dfa-b765-4e3c-929e-a13e6781924f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.597234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.598270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.599880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.613107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 375/756] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:52.620069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.672548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.674089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.674608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.675516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.684659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.686867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:52.706070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.707152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:52.708115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:52.710933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 382/757] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:52.716053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.749279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:52.849584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21218e-c032-4bc9-87e3-4e7d7dfe16f0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.857274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe80fb-e2a1-4b11-bb03-d887ecc8588d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:52.894860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.895673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.895954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.896223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.903738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.905195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:52.920546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:52.921544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:52.922464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:52.922977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:52.923064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 376/758] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:52.923134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:52.923134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:52.923134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:52.923870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:52.927573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:52.927573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:52.927751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.952587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 383/759] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:52.958874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:52.981376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.039709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567bf95-16fe-4d62-a448-4d4cb8c6af12 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.099378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.100106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.100338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.100612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.101490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.101798 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.103224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db8736-b6ce-48f0-8618-423e64c33fc0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.112154 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.132886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 377/760] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:53.132886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471c4c-817d-4cb8-88dd-aa25eb1aa78d None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.132886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471c4c-817d-4cb8-88dd-aa25eb1aa78d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.133209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471c4c-817d-4cb8-88dd-aa25eb1aa78d None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.134610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 378/761] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:53.139088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471c4c-817d-4cb8-88dd-aa25eb1aa78d None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.143614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287009c-9ab1-484f-a5dc-d67ffd698099 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.188071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.189171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.189460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.190024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.190885 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=810cd1c21e2d4f379b02b91885be1882) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.191980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.194186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94176763-f607-42e4-91c0-9c4358cc0da6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.201906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 384/762] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:26:52 2022] GET /identity/v3/role_assignments?user.id=810cd1c21e2d4f379b02b91885be1882&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:53.203637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.204211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.204502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.229661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:53.231183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:53.254505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80471c4c-817d-4cb8-88dd-aa25eb1aa78d None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.263575 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.300741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099960-3765-4007-854b-4e4190824d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.302253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099960-3765-4007-854b-4e4190824d3b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.302541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099960-3765-4007-854b-4e4190824d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.302813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69099960-3765-4007-854b-4e4190824d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.321623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 385/763] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:53.331433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69099960-3765-4007-854b-4e4190824d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.332979 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69099960-3765-4007-854b-4e4190824d3b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-69099960-3765-4007-854b-4e4190824d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:53.365272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:53.367330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:53.369584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:53.369584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:53.369584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:53.369584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:53.370084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 379/764] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:53.370583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.384376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099960-3765-4007-854b-4e4190824d3b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.463869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.507183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d09a2-c7b3-461f-a0ec-62b9d0fc5d00 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.544872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.545709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.545960 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.546272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.546892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.548268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.559759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69099960-3765-4007-854b-4e4190824d3b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:53.560937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:53.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:53.562713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 386/765] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:53.568893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.640091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.641143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.641570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.641985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.642995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.643543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.645788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.671893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 380/766] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:53.679118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.686614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20c92-68f7-4af2-a251-4275f29c304a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.720425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.741140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.741815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.742101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.742372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.743096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] RBAC: Adding query filter params (name=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.743404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.744765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.746736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:53.756565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 387/767] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:53.765942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.832366 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7875a2-7fbf-4ba5-8a36-96d90c305d4a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.875111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.875909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.876191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.876829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.886409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.887859 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.901294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8ac93-a178-445f-83ff-963ee4aa540b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-ac17c8f4-f9e2-4e87-a72e-88198b835f65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:53.907593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:53.908474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:53.909372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:53.913051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 381/768] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:53.914764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677571-f848-4f4c-9a8b-e65748304d11 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.915057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677571-f848-4f4c-9a8b-e65748304d11 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.915337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677571-f848-4f4c-9a8b-e65748304d11 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.916779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 382/769] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:53.921648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677571-f848-4f4c-9a8b-e65748304d11 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:53.960845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:53.961992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.962520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.963000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.963929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:53.964450 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:53.966144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3653-a8f6-4f96-9bea-0ebec5bee103 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:53.977693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 388/770] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:53.979470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:53.980056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:53.980566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:53.998515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:54.000092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:54.020470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.048831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677571-f848-4f4c-9a8b-e65748304d11 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.071283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.084492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 389/771] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:54.085747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.111524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.112657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.112968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.113279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.114201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:54.114650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.116105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.134287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 383/772] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.135207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.229562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e935-b847-44a5-86f5-e429bd7bf1f8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.242350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008c6d0-3904-4ca5-b19b-054f98dae695 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.265847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.266511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.266799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.267081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.267881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] RBAC: Adding query filter params (interface=public, service_id=9bf2c2a856e24738871f3004831fff5f, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:54.268198 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.269623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.280965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 390/773] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/endpoints?service_id=9bf2c2a856e24738871f3004831fff5f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.281115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.281213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.281287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-b94e6b1e-dc67-46db-963f-4946a94d31b4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:54.296348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:54.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:54.298151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 384/774] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:54.299627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9125e-cb86-4e4f-8d7b-777e8fbd617e None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.299627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9125e-cb86-4e4f-8d7b-777e8fbd617e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.299627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9125e-cb86-4e4f-8d7b-777e8fbd617e None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.305293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 385/775] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:54.305293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9125e-cb86-4e4f-8d7b-777e8fbd617e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.308056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.352161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.398296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e61e-8c67-4962-a8f2-e34bcb908d12 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.412116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9125e-cb86-4e4f-8d7b-777e8fbd617e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.433698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.434855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.435319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.435776 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.437976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=861c2da914694e319257102a0fd2f19f, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.439610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.448109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.448862 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.449167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.449445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.450148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.451505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f38a3b-4330-45c7-b3a7-7fb9fbc34904 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.456296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 391/776] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:54 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:54.456296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.477086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 386/777] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.477086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.477339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.477581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.521073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:54.522316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:54.652985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.661994 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 387/778] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:54.670897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f7f7-d001-49f2-9a40-62561c8da29b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.689209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.692192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:54.718058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.718737 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.719030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.719504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.720083 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:54.720393 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.721869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.727687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 392/779] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.733814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.866248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d033d-ca1d-4585-9dce-5b526b0d7bcb None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.886284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bcc-1bfb-4451-a5ad-261c0ade0f55 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:54.933974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.934647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.934977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.935262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.935984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:54.936292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:54.937682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:54.944696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 393/780] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:54.946522 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:54.947328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:54.947612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:54.947883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:54.949949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:54.972705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:54.980536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:54.981453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:54.982269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 388/781] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:54.993958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.054567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.101790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.143737 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e38e0b-b718-4fdf-95c3-b781b3d02dc9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.156169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7f7cc-c2cf-47b9-8045-27819bdcb0d3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.197165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.197985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.198278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.198619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.199388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:55.199700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.201239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.211449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 389/782] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:55.217106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.223255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.225568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.225859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.226142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.226950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] RBAC: Adding query filter params (interface=public, service_id=f6ecc3386cf548589f9955c1ab00e1ba, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:55.227268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.232034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.243725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 394/783] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:26:54 2022] GET /identity/v3/endpoints?service_id=f6ecc3386cf548589f9955c1ab00e1ba&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:55.249262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.411669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112ef52-9371-4ad1-8e1a-f3b074d768b3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.446705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.463376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e2c2-6a4d-4fe7-be02-1842cbdeea38 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.479802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.479802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.479802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.479802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.488089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.503826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.505647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.540249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.541298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.541790 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.542268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.543178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.544746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-eff9c28a-f569-4f5a-8a86-8c714f496a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:55.551113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:55.551975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:55.552845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:55.552845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:55.552845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:55.552845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:55.555298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 395/784] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:55.555755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 390/785] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:55.561701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.606285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13bbd-5687-4f19-80e9-52ae9b164a28 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.606631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13bbd-5687-4f19-80e9-52ae9b164a28 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.606914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a13bbd-5687-4f19-80e9-52ae9b164a28 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.608391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 391/786] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:55.617253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.617588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.617838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.637420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:55.638958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:55.684218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c8d07-e0e2-4cc4-adce-a294eec1adb8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.723566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.724222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.724537 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.724820 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.725799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:55.726112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.727607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.735283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 392/787] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:26:55.742680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 396/788] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:55.748071 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.761390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.795254 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.874810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a98de4-b927-4446-9e88-a26b93ad28fc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.884302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76638c2c-eecd-43e1-9272-a3ab9a464d61 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:55.887141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:55.914954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.915759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.916046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.916323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.929745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:55.934120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:55.935356 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:55.935868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:55.936366 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:55.937949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:55.938898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:55.939757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 397/789] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:55.945731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:55.949882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:55.951666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:55.970080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:55.971261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:26:55.972207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:55.975662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 393/790] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:55.982299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.060310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.071247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434612cd-1f15-414e-925b-ed14529f82c4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.104096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63a31e-026e-4a1e-b494-0008ba21d50c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.107556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.107984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.108273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.108552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.109345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.109658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.111041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.120748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 398/791] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:56.126197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.150872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.151971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.152787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.153231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.154393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.154858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.156726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.211224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 394/792] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:26:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:56.222206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.237506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12827fc-38dd-4fc6-99e5-8a4f53e5cd36 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.272296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.273129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.273419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.274073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.286197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.287728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.301418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:56.306562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.308323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:56.308323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:56.308323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:56.308323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:56.312962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 399/793] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:56.314297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.323888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.427926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0afde-3ea4-43d4-8a11-6c96d7f9ae1c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.462643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.463362 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.463645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.463919 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.476196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.476551 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:56.495328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.496268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.497333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:56.497333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:56.497333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:56.497333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:56.497333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 395/794] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:56.502436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.516607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1acca-359c-44dc-b725-19ff9993a083 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.595384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.596533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.597052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.598124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.599088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.599604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.603045 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.627442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 400/795] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:56.632682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.641220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.677608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b041-1559-41df-8060-ade5425ed456 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.723650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.724672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.725956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.730285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.731335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:56.731924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.733613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.767295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 396/796] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:26:56.773381 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:56.774567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:56.848136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7f0c-d2c2-4c3a-a9f0-51e299a21661 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.921573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:56.922394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.923456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.923740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.933040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:56.934545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:56.954855 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc3ae-be67-4cb6-88f9-96446a7b402b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f613f294-0ab2-4613-b9c5-94cea0aa81d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:56.955047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:56.955924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:56.958115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 401/797] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:56.958706 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52728-7788-469c-a473-d6c39a241b79 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.958784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52728-7788-469c-a473-d6c39a241b79 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.959060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52728-7788-469c-a473-d6c39a241b79 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.960918 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 402/798] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:56.965614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:56.966180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:56.966671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:56.983785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:56.985792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:56.999242 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.002661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.004241 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.004574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.005036 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.014421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.016014 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:57.034434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.035399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 397/799] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:26:57.036930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.069376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 403/800] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:57.070671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.138861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.157127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777f97f-9a0a-46a7-a5f0-66812897cae9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.189351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5f317-540b-4b94-a61c-1400d1fe00d2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.198524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.199206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.199501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.199777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.200683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.201059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.202555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf5cb9-d2bc-442f-ac08-2891e08a604c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.220313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 398/801] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.221634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d9c6-8c86-456c-8838-0aef16dc1cdb None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.221926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d9c6-8c86-456c-8838-0aef16dc1cdb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.222203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d9c6-8c86-456c-8838-0aef16dc1cdb None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.224130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 399/802] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:57.224655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8d9c6-8c86-456c-8838-0aef16dc1cdb None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.236771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.237703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.238662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.238940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.239807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.240072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.241515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205cf6-f431-453c-95bd-e75048cf4f21 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.258192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 404/803] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.258192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.258192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.258192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.274680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:57.275874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:57.286488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.341654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8d9c6-8c86-456c-8838-0aef16dc1cdb None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.346339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 405/804] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:57.347957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.386606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.387497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.387857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.388229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.400087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:26:57.403621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:26:57.408235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.409386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 400/805] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.415769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.469073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa421e-a818-4ece-9385-75834c4aaed0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.512093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.513566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.513851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.516699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2deab-6bce-4b78-b5f1-8c299ee8ab67 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.525166 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.526617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.529082 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:57.545902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.546992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.547951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:57.547951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:57.547951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:57.547951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:57.547951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 406/806] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.548377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.562815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.563712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.564000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.564476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/22a8f4b7fb6e4783aac4f34e57ec19fc/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.579603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=22a8f4b7fb6e4783aac4f34e57ec19fc, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.581073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.599926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 401/807] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:57 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/22a8f4b7fb6e4783aac4f34e57ec19fc/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:57.601078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.680371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.686446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26170a05-ef31-46bb-aec2-9b5f7ef1a389 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.734101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7aa50-b51f-4228-88e9-f8dcab6a1cc6 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.741161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.742076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.742457 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.742811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] PATH_INFO: `/v3/services/network` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.743549 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.745878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:57.763440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:57.764476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:57.765563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 407/808] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:57.766448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.785963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.786697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.786945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.787226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.787997 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.788310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.789721 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.799058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 402/809] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.800054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.846676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.887754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5e1a-9492-496c-8ae5-9f418752c53a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.923342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.924135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.924490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.924836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.925704 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.926026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3cf11-fcee-4f50-92f2-e618220670f3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:57.926144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.927512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.944891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 408/810] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.944891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:57.971681 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:57.980353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:57.981470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:57.981850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:57.982221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:57.983033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] RBAC: Adding query filter params (name=network) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:57.983435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:57.985479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:57.993939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 403/811] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:57.995397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.063973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd422f9-d4ff-47dc-87cb-5af8d972070a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.101090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.101888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.102170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.102449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.105436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.113467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.114968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.122547 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f03e9-383e-4e8b-84f3-42b7aec43479 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:58.133428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.134344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.135217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:58.135217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:58.135217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:58.135217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:58.135217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 409/812] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.135506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.163952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.164752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.165069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.165427 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.172767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.174310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-3439676e-193f-4da1-8019-ff78fc069c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:26:58.189673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.190584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 404/813] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258322-9a54-4d08-bb7b-c70dda97dcb2 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.197301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258322-9a54-4d08-bb7b-c70dda97dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.197893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258322-9a54-4d08-bb7b-c70dda97dcb2 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.197893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 405/814] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:26:58.197893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258322-9a54-4d08-bb7b-c70dda97dcb2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.225340 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.255541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651824-f92e-4080-bc39-ddb2faa3cfda None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.290906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.291572 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.291849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.292127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.292833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] RBAC: Adding query filter params (type=network) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.293164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.294523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.299648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 410/815] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.300993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.314479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258322-9a54-4d08-bb7b-c70dda97dcb2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.353255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.354212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.354730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.355185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.356128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.356625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.358426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4a184-bc91-4e82-8ead-695b0feaa136 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.371505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 406/816] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.373105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.373453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.373789 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.380571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.393643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:58.394852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:58.408179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d3a-8e52-4953-8dac-8bd1d1ca5846 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.445555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.446311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.446657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.447131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.448005 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:58.448315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.449811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.456807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.464615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 407/817] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:58.465370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.475646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 411/818] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:58.475646 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.577219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c836b41-ea1e-4700-8447-7cce3cf81536 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.584490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c4670-caa2-4b19-aaf6-972caf8e49b5 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.614461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.615426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.615869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.616289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.617398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.619074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.619513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.620306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.620596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.620905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.624607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.629093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.630640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:26:58.646496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.647566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:58.648574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 412/819] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.649227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 408/820] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:26:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:58.649310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.649381 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.733903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:58.787240 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84b54-e1b2-4d92-b5e9-44bd85ccf8c2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.801817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a16a-5d77-46af-9f58-dc42c3489396 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:58.832789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.833804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.834182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.834545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/810cd1c21e2d4f379b02b91885be1882/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.836631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=810cd1c21e2d4f379b02b91885be1882, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.840767 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.857286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 413/821] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:26:58 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/810cd1c21e2d4f379b02b91885be1882/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:58.859107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:58.859247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.860125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:58.860800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:58.861243 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:58.862025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:58.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:58.878047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:58.879272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:26:58.880317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:26:58.881282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 409/822] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:58.890567 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:58.961666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.003924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010098b2-e0ba-44f6-bd1c-f6b013883c86 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.031267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.032335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9787-96f9-4654-b08e-e9ee076b25ea None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.060796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.061799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.062238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.062664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.063803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.064732 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.066573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.088229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.090009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.090009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.090198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.091168 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.091655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.092748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.093304 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 414/823] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.101898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.102569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 410/824] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.108976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.217454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9546-3796-43dd-8a4d-9cea1bb68b5f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.233938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a3886-3798-4c43-9e86-2e5f76b9ae8c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.251895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.256119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.257248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.257718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.258180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.279367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.281142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.281762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.283273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.284182 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.284931 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.286577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.292447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 411/825] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:26:59.300162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.318141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.347294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.349221 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.417017 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2134a-17fe-4392-baef-937248f6499f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.459395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.460090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.460381 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.460664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.461484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.462868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06045662-d84e-4a5a-a344-0787fa73cc93 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.470555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 415/826] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:26:59.476139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.495562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 412/827] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:26:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:26:59.572027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.598625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36635a-7038-404a-9d16-7b146fde98fb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.765781 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.766823 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.767277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.767698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.779236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.780869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:26:59.799116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:26:59.800265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:26:59.801403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:26:59.801403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:26:59.801403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:26:59.801403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:26:59.804089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d845df-62f4-4c08-8b3e-8f660311dfdf None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.804540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d845df-62f4-4c08-8b3e-8f660311dfdf None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.804713 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d845df-62f4-4c08-8b3e-8f660311dfdf None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.806217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 413/828] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:26:59.809811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 416/829] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:26:59.812400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.812709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.814181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.814322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.834944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:59.836143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:59.872317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.926135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90b2f6-d814-4e79-8daa-a43d9e929bbe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:59.927574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 414/830] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:26:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:26:59.960873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:59.961077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:59.975133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:59.975859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:59.976145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:59.976561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:59.977928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:26:59.978239 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:59.980135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:59.997012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 417/831] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.001208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.070093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a6992-0d54-4415-a54d-6161db928e6f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.109129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.110378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.110764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.111276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.123712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:00.131348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3cb3-4344-4b2d-a6c9-99eeae865b2f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:00.134199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.135326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:27:00.136329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:00.142951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 415/832] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:26:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.143901 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.167649 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.168483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.168770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.169290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.177085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.177679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.178533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:00.193595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.194487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:00.195358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:00.199801 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 418/833] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.200662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.249626 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.250414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899eac-04c0-4653-a8c2-2f0e793e6df1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.285564 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8818-d231-4919-a185-2c02770d971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.286291 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8818-d231-4919-a185-2c02770d971e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.286577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8818-d231-4919-a185-2c02770d971e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.286854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8818-d231-4919-a185-2c02770d971e None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.287651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8818-d231-4919-a185-2c02770d971e None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.287965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8818-d231-4919-a185-2c02770d971e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.289357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8818-d231-4919-a185-2c02770d971e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.302618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 416/834] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:00.303669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8818-d231-4919-a185-2c02770d971e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.309234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c69e9-aff7-48dd-ba6b-bea97634aad6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.349651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.350417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.350709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.351087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.351886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.352201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.353786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.372728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 419/835] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.373660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.391928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.407869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8818-d231-4919-a185-2c02770d971e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.443591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.444430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.444721 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.445029 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.456409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.458425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:00.477574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.478716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.479691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:00.479691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:00.479691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:00.479691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:00.483549 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 417/836] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:00.484583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.499630 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ffec73-cab6-4aed-b9c5-5c9ef0d963cf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.502518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.540466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.541180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.541467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.541752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.542607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.542923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.544493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.557262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 420/837] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.599083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5f15-71ab-4e76-bde7-c49a12d333fd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.637639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.638583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.639044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.639490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.640423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:00.640921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.642579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.650941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:00.657814 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 418/838] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:00.664419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.783487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f687a-2470-49a3-8d16-0be0d6a31928 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:00.820364 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:00.825100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:00.825100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:00.825100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:00.833702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:00.835371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:00.853846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:00.855058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:00.856152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:00.858304 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 421/839] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:00.864066 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:00.968461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73037ad0-50c0-4488-b910-57c5dc6994c0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.004896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.005813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.006272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.006848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.007890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.008345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.009944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0340b8-329b-4a34-9aee-f0765e21e8fc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.028640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 419/840] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.034504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.065897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.069104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd94ec-e546-4aa8-ba47-b74fd2bc0577 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.069445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd94ec-e546-4aa8-ba47-b74fd2bc0577 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.069730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd94ec-e546-4aa8-ba47-b74fd2bc0577 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.071219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 420/841] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:01.076255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.076538 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.076814 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.093141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:01.094310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:01.154900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.162735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345061-a0e9-492d-9c41-618f3e58d374 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.176712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 421/842] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:01.200034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.204751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.205642 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.206078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.206533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.294270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.296552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.311871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8deef-10ac-4d7b-8364-2c0e38fc4d19 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.334301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.350318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.351230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.351588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.351937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.363949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:01.373684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:01.374822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:01.375839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:01.377657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 422/843] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:01.384020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.435890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 422/844] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:01.436799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.445506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.515153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42707ab-7568-4faf-8b65-996dfbac0834 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.558062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.558896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.559180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.559457 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.560210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.560515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.561525 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cc61b-ddf4-490a-8c5f-86f058582b8b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.561897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.573012 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 423/845] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:01.577382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.595302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.604793 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.605698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.605962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.606236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.618215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.619709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-effa98a3-d3ff-42c2-ade2-1e609e5565e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:01.637350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:01.638242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:01.639114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:01.639114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:01.639114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.639114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:01.643111 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 423/846] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:01.644293 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2299-0f18-47a2-867f-be5a78aafe75 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.644581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2299-0f18-47a2-867f-be5a78aafe75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.644876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2299-0f18-47a2-867f-be5a78aafe75 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.650331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 424/847] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:01.650331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e2299-0f18-47a2-867f-be5a78aafe75 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.693735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea846-550c-498b-be10-b751d13a9ec7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.703099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.731009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.731910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.732196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.732467 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.744375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.746076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.754717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e2299-0f18-47a2-867f-be5a78aafe75 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e8e6faf5-afc0-4dd7-b1fa-7db3ce361e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:01.763934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:01.765035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:01.766201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:01.766201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:01.766201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:01.766201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:01.770202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 424/848] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:01.771473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.771762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.772041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.788945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:01.790151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:01.793477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.794140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.794426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.794709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.795433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.795744 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.797133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.815009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 425/849] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.815009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.860986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 425/850] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:01.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:01.934996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68162b5e-a6fc-49c2-acc9-3c025a1d2fbc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.969573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:01.972836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:01.973868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:01.974148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:01.974705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:01.975447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:01.975919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:01.977931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:01.979136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb732b-5577-4537-b2a0-9e42ca3b843f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:01.991913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 426/851] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:01.992738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.019017 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.020020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.020488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.020766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.027829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.029286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:02.044151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:02.045097 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:02.045989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:02.050712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 426/852] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:02.051539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.102014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.105702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa499-dccf-42cb-95cd-d8b4864a084a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.141768 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.142566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.142855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.143134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.143790 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.145337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.155965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa09179-4fa7-4270-9014-9f80e6c1a6ea None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:02.158366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:02.159367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:02.160718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 427/853] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:02.161536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.196613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.197452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.197732 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.198001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.205436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.206907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:02.220910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:02.221879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 427/854] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:02.223357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.237230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.280519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef5920-43e7-4b44-a31e-dfaaac6e3f9a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.317595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.318375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.318659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.318988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.319780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.320141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.321833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.329494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f6d35-f23e-4f21-9059-f107ee04e588 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.335854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 428/855] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.337075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.363982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.370020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.370767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.371051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.371321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.372028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.372331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.373708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.383515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 428/856] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.383515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.449944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f356-6329-4520-a5db-e2cc181d1995 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.469998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.487141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.488373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.488658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.488991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.489806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.490114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.491523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.501048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb02c1-3e75-47e9-81ae-c7cf668d3499 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.510718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 429/857] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.511826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.540345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.541116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.541427 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.541669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.542508 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=22a8f4b7fb6e4783aac4f34e57ec19fc) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.542822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.544235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.550377 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 429/858] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/role_assignments?user.id=22a8f4b7fb6e4783aac4f34e57ec19fc&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.550993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.616479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.642613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969ab17-ee17-42e6-9d78-9c99231103d1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.678804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1192d-ffab-48d1-8bb4-a16a15c51afc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:02.694140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.694819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.695101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.695376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.696107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:02.696418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.697860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d6e12-67cd-4510-8979-87c75ae99713 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.703795 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 430/859] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:02.736127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:02.737335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.737802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.738597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.749108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:02.776251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6195f-b3f1-43e3-b5c6-6a28034a61f9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.776593 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6195f-b3f1-43e3-b5c6-6a28034a61f9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.776814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6195f-b3f1-43e3-b5c6-6a28034a61f9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.778794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 431/860] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:02.785146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:02.785452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:02.785725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:02.808898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:02.809715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:02.831881 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:02.833376 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:02.910157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 432/861] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:02.931456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:02.959271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 430/862] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:02.965725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.014788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.018089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.042819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f5ee7-a924-468a-9608-58341a651943 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.081425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.082894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.083273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.083663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.084418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.085905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:03.098863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:03.100009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:03.101072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:03.102813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157977-29f9-471c-a08f-5c77fa918a8f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.103237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 433/863] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:03.110601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.143487 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.144845 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.145170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.145446 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.156240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.157727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:03.177091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:03.178194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:03.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:03.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:03.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:03.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:03.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 431/864] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:03.186653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.254447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3e76-d7da-40b8-87db-d7f29b4b504d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.284795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.290507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.291178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.291459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.291741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.292505 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.292943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.294794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.297336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559a85c-fa00-434a-833e-3b9b36307884 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.304800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 434/865] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:03.305854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.309233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.334335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.334999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.335288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.335570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.336371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.336614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.338030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.350800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 432/866] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:03.356001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.417809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f248-634b-42c6-b318-502802c7b80a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.465245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.465848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.466139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.466418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.467157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.467469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.469417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.480958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 435/867] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:03.511012 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a1c54-ce3e-4e5a-a947-a71b538539bc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.551470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.552293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.552575 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.552864 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.560678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.562183 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:03.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:03.578776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:03.579673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 433/868] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:03.585354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.658256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.700496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a393fa8-e42d-4c80-acab-db7c6ce5488d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.735212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.735893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.736177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.736454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.737279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.737638 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.739552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b9d04-0492-4a72-bbb4-57a24466b0a2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.753154 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 436/869] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:03.758597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:03.771655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:03.872069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4fa78-d62c-4963-8a5d-29289cddd932 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:03.913778 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:03.914430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:03.914710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:03.914984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:03.915819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=810cd1c21e2d4f379b02b91885be1882) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:03.916126 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:03.917578 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5829222-292d-46bd-8632-29ac41be9ade None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:03.923993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 434/870] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:03 2022] GET /identity/v3/role_assignments?user.id=810cd1c21e2d4f379b02b91885be1882&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:04.802003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40586-a61a-418d-be8f-f3d3aa920cf5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.803015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40586-a61a-418d-be8f-f3d3aa920cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.803530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40586-a61a-418d-be8f-f3d3aa920cf5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.805386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 437/871] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:04.810674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.811476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.811960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.822925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6c31-a9bb-4e9f-bf9a-6486241e7f8c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.823205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6c31-a9bb-4e9f-bf9a-6486241e7f8c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.823477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6c31-a9bb-4e9f-bf9a-6486241e7f8c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.825081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 438/872] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:04.833677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:04.834320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:04.834824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:04.835334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:04.835803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:04.858731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:04.860048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:04.913552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 435/873] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:04.936614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:04.940003 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:04.948875 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 439/874] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:04.971558 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.033042 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.044724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b493c-8e34-44af-bd58-457ea1616154 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.078682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0f11-08d5-47fc-8d17-65ae51cac601 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.082136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.083292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.083833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.084319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.096225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:05.105667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.106602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:05.107430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:05.114934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 436/875] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:05.116020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.119705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.120381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.120667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.120974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.122136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.123072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.145163 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 440/876] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:04 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:05.189053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.233465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f3a49-1f1f-4913-a72f-b8f15f1f01ea None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.278359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.279038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.279326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.279602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.280382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:05.280690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.282118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.291796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 437/877] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:05.297650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.405200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1297f2-2ca5-4271-9754-f0fe3fb5770f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.422622 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.441908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.442989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.443281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.443560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.455208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.457258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0927b0d3-f832-46fa-afbf-72c9f0e6df7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:05.475074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.476014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.476923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:05.476923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:05.476923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:05.476923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:05.476923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 441/878] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:05.482236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.590271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b6ad-ce43-4f38-b1dd-8148434c4abc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.590593 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b6ad-ce43-4f38-b1dd-8148434c4abc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.590832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b6ad-ce43-4f38-b1dd-8148434c4abc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.592460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 442/879] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:05.594902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b93cc2-6b17-44d9-8eff-fdabe8771a91 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.597415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.597708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.597994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.615297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:05.616496 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:05.629058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.633507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.634653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.634957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.635500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.636474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:05.637044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.638808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.654875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 438/880] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:05.661052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.705089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 443/881] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:05.724125 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.792603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfafb8-5c71-499b-8b6f-984d064f61dd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.838540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:05.841681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.842559 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.842869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.843245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.844449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e1fb9-13e5-4496-b54f-a2b88da50510 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:05.853365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.855350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:05.877201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:05.878760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:05.879708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 439/882] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:05.884466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:05.892840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:05.893556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:05.894411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:05.894696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:05.895446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:05.896985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63f475-754c-4ffe-8f1e-07a1a7672c52 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:05.915616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 444/883] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:05 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:05.947618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.013889 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ae5b3-d8c1-47af-afaa-6070b19d03c0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.032795 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141cc2-c44f-41ec-8dde-d05e5c65e84f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.033116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141cc2-c44f-41ec-8dde-d05e5c65e84f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.033398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141cc2-c44f-41ec-8dde-d05e5c65e84f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.038906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 445/884] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:06.040827 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.041147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.041433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.059337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:06.060552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:06.069616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.070324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.070612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.070890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.072162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.072540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.074723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.098115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 440/885] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:06.105384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.153888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 446/886] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:06.177294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.224156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.231070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795f0c-806a-4f6b-9b51-fe732000d41f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.268802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.269382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.269660 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.269930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.291296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.298370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b368c6e-7c48-45c5-b921-7d00bafc1621 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.344668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.345810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.346310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.346766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.346909 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.347760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.348442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.349526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.362127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.363688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:06.364524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:06.367629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 447/887] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:06.373332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.464478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.479208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 441/888] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:06.484777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.500425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280b9b-c200-45f8-98bf-91500dc8c869 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.547928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.549249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.549700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.550647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.551525 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.552022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.553637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.564135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 448/889] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:06.567430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.589257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.614157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf666-fd57-476e-a7f4-440f50e5d759 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.649972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.650933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.651324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.651699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.663221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.664792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.681934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbffd-d572-4402-bd05-af928ec5c53c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:06.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:06.684438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:06.685315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:06.685315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:06.685315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:06.685315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:06.689947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 442/890] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:06.690890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.723629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.724107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.724557 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.725571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.726142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.727814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.741041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 449/891] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:06.742449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.807503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8dba8-0b58-416e-9367-8adddce60403 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:06.845291 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:06.846027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:06.846395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:06.846689 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:06.848018 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:06.848333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:06.849824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:06.866548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 443/892] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:06.872266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:06.966330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:06.986538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eab1e-55d2-49b2-8ca3-c18b98455e18 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.022301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.023156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.023443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.023716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.031088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.032586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:07.047933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.048889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:07.049953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 450/893] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.055162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.163130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f876b79-9b8e-45cd-890a-babbb39cef0f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.172988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.199897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.200869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.201367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.201816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.202780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.203262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.205272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd031d75-5bac-4f81-a0f5-3c8a8cc4a68c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.218985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 444/894] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.225236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.330941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a951e7-eeca-46c1-9aef-5e8bc1d2dbf6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.358475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c691c63-d827-4ba9-9b85-a2fba8c4ce1c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.358792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c691c63-d827-4ba9-9b85-a2fba8c4ce1c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.359024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c691c63-d827-4ba9-9b85-a2fba8c4ce1c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.361128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 445/895] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:07.367358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.367985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.368360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.373678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.374538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.374976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.375423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.376424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] RBAC: Adding query filter params (role.id=8d9cf4d2b87d479b9245a95170160f2d, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=22a8f4b7fb6e4783aac4f34e57ec19fc) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.377025 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.379145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.385624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 451/896] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/role_assignments?user.id=22a8f4b7fb6e4783aac4f34e57ec19fc&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=8d9cf4d2b87d479b9245a95170160f2d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.388791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:07.390221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:07.477468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 446/897] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:07.495847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.505999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.604721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f910236-d03d-4560-8b50-ee4aa5d4113c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.639997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.640798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.641377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.642039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.643471 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:07.656578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:07.657586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:07.658432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:07.662812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 452/898] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:07.664160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.766144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdcf48-3c63-4428-8c7a-7b8be44ff01c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.769421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.804223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.804986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.805277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.805553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.806269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.806576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.807937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.813188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 447/899] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.819392 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:07.898109 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:07.932656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513936e-2a59-4bf4-a407-a710beeb76f1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:07.969329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:07.970019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:07.970305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:07.970581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:07.971297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:07.971604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:07.973614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1eb078-6233-4663-b677-719f5952145c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:07.979351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 453/900] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:07.985113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.070749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734b0-d754-4117-b0c0-cb90a007242f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.071075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734b0-d754-4117-b0c0-cb90a007242f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.071320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9734b0-d754-4117-b0c0-cb90a007242f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.072969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 454/901] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:08.077962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.078255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.078538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.090420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2aedd0-2956-4634-8b7f-28faa1843a56 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.098131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:08.099751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:08.133307 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.134528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.134942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.135225 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.136046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] RBAC: Adding query filter params (interface=public, service_id=2aa25549000e4e91a65f47f6ae15b079, region_id=RegionOne) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.136363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.137775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.152995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 448/902] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:07 2022] GET /identity/v3/endpoints?service_id=2aa25549000e4e91a65f47f6ae15b079&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.154479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.180551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 455/903] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:08.190132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.206697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.274379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.285262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7a414-0284-442a-8319-90366b5422c4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.316187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d29b2-15ad-4187-9f05-1afc0eaa9011 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.329318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.329990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.330277 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.330555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.331817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.333224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.344974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 449/904] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:27:08.364519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.365399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.365688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.365968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.366642 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.368117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:08.381993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:08.383021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:08.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 456/905] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:08.389701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.509235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.518543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923898-dc8a-4f0c-b6af-9b6d4de1b7e3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.556432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.557163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.557450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.557729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.558477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.558793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.560220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.567047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 450/906] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.572407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.679171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846a46-355a-4120-98b5-de6487e8270d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.706590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:08.715407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.716099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.716420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.716707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.717542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.717859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.720049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.725599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 457/907] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:08.731193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.845654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a290ac-622c-4b0c-8d08-305630be5e43 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:08.886999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:08.887743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.888024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.888302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.889136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] RBAC: Adding query filter params (interface=public, service_id=67d01b2a05f74bcb956cf3ff602d8432, region_id=RegionOne) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:08.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:08.890939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e56219-4767-4d0b-82fa-a5341914e532 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:08.897293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 451/908] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/endpoints?service_id=67d01b2a05f74bcb956cf3ff602d8432&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:08.902756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:08.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724cf6-c6b4-4741-b3b2-c6f05e28fd37 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724cf6-c6b4-4741-b3b2-c6f05e28fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.963512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a724cf6-c6b4-4741-b3b2-c6f05e28fd37 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.964400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 452/909] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:08.969640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:08.970177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:08.970677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:08.989139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:08.991099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:09.005332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.025152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33f8f2-79ff-479f-aaea-219678692aee None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.073054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.073054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.073054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.073054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.073477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.073477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b3e9-16d2-48f3-8edb-64bb027bb0d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.073846 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 453/910] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:09.079012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 458/911] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:08 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:09.093961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.219883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf894d-3d18-4878-8f39-d0f295ea5f27 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.257789 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.258455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.258740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.259015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.259734 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.261115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eb873-96f3-4bd1-8c56-0484700a37e3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.277344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 454/912] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:09 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:09.514139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462e44-6911-455f-b5d7-7528be2dfccc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.514507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462e44-6911-455f-b5d7-7528be2dfccc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.514710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462e44-6911-455f-b5d7-7528be2dfccc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.516351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 459/913] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:09.521840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.522134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.522617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.540232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:09.541444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:09.543687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.627115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 455/914] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:09.649763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462e44-6911-455f-b5d7-7528be2dfccc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.716951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.770633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462e44-6911-455f-b5d7-7528be2dfccc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.806680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.807495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.807780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.808052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.819056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:09.827097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:09.828105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:09.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 460/915] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:09.834430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:09.935314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb0b47-d30c-4da0-bce2-45e9f144edd1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:09.969622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:09.970290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:09.970569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:09.970841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:09.972420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:09.973977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:09.975370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:09.976844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:09.986136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 456/916] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:09.992040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.096564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61281-8be0-49bd-837b-c996966c8492 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.113871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.131893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.132681 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.133001 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.133272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.144224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.145689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:10.164686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.165669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.166566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:10.166566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:10.166566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.166566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:10.166566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 461/917] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:10.173672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.285962 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbbff5-fc6f-4a49-bf4e-da684e4fa49a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.323185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.324245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.324747 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.325280 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.326235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:10.326755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.328327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.341519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 457/918] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:10.347182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.455265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c681-924b-40bf-924c-767d8d6d8055 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.492707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.493550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.493835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.494110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.502194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.503645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0bef1bf2-a384-4d1e-a411-7dab0424b47e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:10.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.522592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:10.523813 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 462/919] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:10.528368 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.590797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.610427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836290-3d29-4a58-8d7b-f812c1f10bae None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.610696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836290-3d29-4a58-8d7b-f812c1f10bae None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.610929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81836290-3d29-4a58-8d7b-f812c1f10bae None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.616809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 463/920] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:10.618030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.618326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.618614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.637578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:10.638779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:10.646625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c79e-57f8-4ddf-af4f-ee51668ff1ec None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.663560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.686019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.687028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.687521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.688086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.689186 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:10.689709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.691364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.714886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 458/921] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:10.716629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 464/922] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:10.717762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.742818 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.827050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361909-c6f4-467e-ba44-5697aad134cc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.844224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:10.864669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687ffa1-6402-495e-bb5f-bdffdeb20600 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:10.866980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.868804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.869323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.869794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.883540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.885334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.901047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:10.901988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:10.902634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:10.902908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:10.903562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:10.905033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:10.910630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.911546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.912413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:10.912413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:10.912413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:10.912413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:10.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:10.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:27:10.922129 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:10.923407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 459/924] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:10.924407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 465/924] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:10.925344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.925760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:10.952183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.040272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d313fd9-b999-4150-beba-8e729a4a7f7a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.053169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715bbca-5bbe-492c-963a-3d97612b4502 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.085171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.086651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.087235 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.087711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.088641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.089183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.090724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.090842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.091398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.091683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.091961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.092944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.093256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.094690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.098779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 466/925] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:11.104062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.120905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 460/926] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:11.122493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.158947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.204864 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.223899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e4cf-ad92-43b8-8009-bed40974f9f6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.250237 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a996d8-72bf-4051-8bf0-4da90287796c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.260579 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.261373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.261724 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.262065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.262940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.263312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.264941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26197328-5865-48f3-852b-b51092d96ef3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.275951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 467/927] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:11.277655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28d6a-86f3-40da-8a92-6ecb7e9dc3fd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.277941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28d6a-86f3-40da-8a92-6ecb7e9dc3fd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.278216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28d6a-86f3-40da-8a92-6ecb7e9dc3fd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.279687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 468/928] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:11.280213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28d6a-86f3-40da-8a92-6ecb7e9dc3fd None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.296061 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.296886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.297161 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.297437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.305356 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.306788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-b3836083-faa2-4fe2-8684-09c65a2ce3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:11.321946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:11.322834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:11.323716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 461/929] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:11.325187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.325187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.325187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.341899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:11.343079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:11.393394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28d6a-86f3-40da-8a92-6ecb7e9dc3fd None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.411759 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 462/930] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:11.412512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.433208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.434144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.434429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.434707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.434805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.435460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.436999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21316989-165c-4860-99a0-f9fead9792fb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.457976 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 469/931] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:11.459290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbe49-8b6b-43d4-ac00-c1e6408f5a3f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.459579 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbe49-8b6b-43d4-ac00-c1e6408f5a3f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.459855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbe49-8b6b-43d4-ac00-c1e6408f5a3f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.461121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 470/932] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:11.461836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbe49-8b6b-43d4-ac00-c1e6408f5a3f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.475073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.542142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aaab0-706c-483c-ae0d-4b60b9a93830 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.588535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbe49-8b6b-43d4-ac00-c1e6408f5a3f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.588803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.589349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.589641 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.589922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.590863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.591294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.592764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08c2d5-d096-4dff-b961-c59d927bdebd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.610884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 463/933] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:11.610884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.610884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.610884 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.625501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:11.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:11.635445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.636269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.636555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.636837 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.637670 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.639170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:11.654095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:11.655057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:11.656116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 471/934] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:11.657250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.705107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 464/935] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:11.706424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.709683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.732195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:11.775179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c570c5f-d43c-4964-a4b7-c3344bf0406f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.817023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.817921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.818207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.818708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/22a8f4b7fb6e4783aac4f34e57ec19fc/roles/8d9cf4d2b87d479b9245a95170160f2d` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.820722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=22a8f4b7fb6e4783aac4f34e57ec19fc, role_id=8d9cf4d2b87d479b9245a95170160f2d)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.822188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.824670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f026-eaa7-4ad9-98aa-90dc58de630a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:11.836900 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 472/936] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:11 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/22a8f4b7fb6e4783aac4f34e57ec19fc/roles/8d9cf4d2b87d479b9245a95170160f2d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:11.837969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.878698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:11.879511 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:11.879862 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:11.880211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:11.881072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:11.881450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:11.883246 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:11.888838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 465/937] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:11.898935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:11.974445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d86d1-be71-4c2c-853f-161e953af7be None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.004836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.011196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.015094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.016028 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.016317 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.016592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.018089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.019652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:12.035350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:12.036405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:12.037268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 473/938] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:12.043905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.046705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d38f4-b541-4d12-a928-4a929dce1780 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.091065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.091743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.092065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.093026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.098249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.098596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.100463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.107633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 466/939] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:12.113273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.174416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e5ae-d727-4e1f-9798-a1477ec75836 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.221068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.221830 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.222119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.222398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.223119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.223428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.225191 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.235068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 474/940] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:12.236366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.244749 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16018-e6b5-4861-82af-710fd219a792 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.278023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.285112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.286048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.286543 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.287011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.287965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.289646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.299107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.319195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 467/941] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:12.363714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be5e1-1cff-4cea-a000-e68bc14bc9b2 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.408287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.409460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.409946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.410428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.411345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.411851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.413485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.419657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 475/942] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:12.426285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.537350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e4c19-bbca-4d1c-a114-97f5a8c3e460 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.575848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.576516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.576803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.577133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.577944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] RBAC: Adding query filter params (interface=public, service_id=c6f21421bb8b4033a91e1b514a44756a, region_id=RegionOne) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:12.578263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.579780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02911ce-fed6-4b31-bb76-699d7cc60fd4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.585942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 468/943] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/endpoints?service_id=c6f21421bb8b4033a91e1b514a44756a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:12.591249 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:12.700489 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a39a7-100e-4089-a8e9-9cd07123d9b7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:12.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:12.737989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:12.738921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:12.739401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:12.739860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:12.740749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:12.742361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fbd6-c505-4916-8557-1ed8d5cba9f8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:12.749088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 476/944] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:12 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:27:13.565712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7d86-2ab5-40f7-9022-34f09bef1daa None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.566410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7d86-2ab5-40f7-9022-34f09bef1daa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.566410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b7d86-2ab5-40f7-9022-34f09bef1daa None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.567780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 469/945] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:13.573547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.574478 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.574979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.592172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:13.593700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:13.662275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 477/946] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:13.686264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7d86-2ab5-40f7-9022-34f09bef1daa None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.741438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:13.796051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b7d86-2ab5-40f7-9022-34f09bef1daa None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.840552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:13.840552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.840552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.840552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:13.840999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:13.840999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:13.840999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING keystone.server.flask.common [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:27:13.859448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.sql.core [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:13.859448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:27:13.859448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [parameters: {'id': 'd3433a67fc134b4f9f0405d78d636a1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:27:13.859448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80384) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-30a470e2-af20-4b51-af19-16cc7e66a656 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3433a67fc134b4f9f0405d78d636a1a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3433a67fc134b4f9f0405d78d636a1a. Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:13.879675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 14:27:13.880574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application yield resource Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise self.value Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application session.commit() Jul 11 14:27:13.881540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:27:13.882452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:27:13.883334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:13.884128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [parameters: {'id': 'd3433a67fc134b4f9f0405d78d636a1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.886127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:13.888037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3433a67fc134b4f9f0405d78d636a1a. Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:13.889758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 470/947] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Jul 11 14:27:13 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:13.890439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:13.998432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f942b2-c78e-4792-93cf-c3bfe00f3556 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:13.998636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f942b2-c78e-4792-93cf-c3bfe00f3556 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:13.998771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338fa2b-945a-49e9-9409-cd1069d851df None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:13.998882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f942b2-c78e-4792-93cf-c3bfe00f3556 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.003717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 471/948] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:14.008704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.009030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.009306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.013164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.031839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:14.033882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:14.041718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.042960 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.043451 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.043928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.052244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.054624 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:14.075571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.076481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:14.077423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 478/949] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.082494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.116284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 472/950] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:14.139492 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.179950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.219113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4c3b-53ff-465e-8267-a1693479f2bf None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.254705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.255287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.255713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.256003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.257093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.257408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.259079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.260060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ff47b-83cd-4fc7-809d-99861f1cdeed None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.280774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 479/951] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.304946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.305792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.306076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.306351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.318929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:14.327437 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.328422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:14.329331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:14.333308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 473/952] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:14.335461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.377306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.446538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700523-8895-4478-ab01-d291326d3a5d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.484814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.485518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.485800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.486077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.486835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.487710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.489089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3dd0-6327-4c9e-bb4a-097d28857c3c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.498027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 480/953] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.503614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.605823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.611504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364207-80ca-418a-b3c2-2486b6e13c49 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.619504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a1c-fe67-417f-abdc-dfa88587084d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.620027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a1c-fe67-417f-abdc-dfa88587084d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.620027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8160a1c-fe67-417f-abdc-dfa88587084d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.621677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 481/954] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:14.630373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.630658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.630939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.653322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:14.654526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:14.664266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.665401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.665891 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.666395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.680985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.682963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:14.703968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.705607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.707555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:14.707555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:14.707555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:14.707555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:14.715513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 474/955] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.716746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.764873 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 482/956] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:14.782957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.811372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.845970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d54dd1-687d-4c1a-b088-71a59c22ca66 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.900267 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.901675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.902426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.902897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.903871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:14.905032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.907304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348325e1-3b0f-4bc8-8645-4efb9b308239 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.921669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140164e2-2ee2-4cad-ad8a-91e427ec7d4f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:14.930440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 475/957] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:14.930440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfacbd-7042-466d-a02e-64b77883e663 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.930440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfacbd-7042-466d-a02e-64b77883e663 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.930440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfacbd-7042-466d-a02e-64b77883e663 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.932989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 476/958] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:14.934680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfacbd-7042-466d-a02e-64b77883e663 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:14.960048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:14.960427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:14.961271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.961566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.962104 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.962516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:14.963925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-2a157537-ad05-4a13-b275-07a1fb2bd02b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:14.977233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:14.978391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:14.979328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 483/959] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:14.980120 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:14.980120 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:14.980240 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:14.998222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:14.999460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:15.073178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfacbd-7042-466d-a02e-64b77883e663 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.076701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 484/960] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:15.077452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.104225 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.113333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.114239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.114449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.114709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.123230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.124684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:15.141613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.142618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 477/961] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.143692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.223836 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.224177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e244-577c-4975-b3cb-efbdf8ffcdbc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.265331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3733f7-76ef-498a-935f-10d0f665bc2b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.270766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.271445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.272252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.272533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.273287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.274072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.275809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.287305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 485/962] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.287305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.302102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.302912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.303382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.303667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.304329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.305725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:15.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:15.325194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:15.327150 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 478/963] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:15.328990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.399000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.427968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f42617-4cd8-450a-a30d-7a3dd1a5422d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.448723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b277-44c6-46df-885a-c41f725e4660 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.470218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.471021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.471160 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.471473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.472329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.472628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.476362 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.488665 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.494445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 486/964] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.494608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.495207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.499754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.499995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.500282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.501051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.501364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.503331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.512920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 479/965] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.512920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.611058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb137a51-596c-4a7a-8810-75392bf4afe7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.649961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.650616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.650905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.651527 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.652164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.652486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.653939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.656072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.658334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018a41-4ef1-4436-b32b-4fc483ebe0d7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.666499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 487/966] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.672144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.706250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.707188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.707493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.707772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.787650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:15.797510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.800197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.801323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82758aa-26a7-450d-a0cb-832f3a76d534 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:15.850312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:15.850994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:15.851281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:15.851717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:15.852725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:15.853071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:15.854459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:15.861693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 488/967] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:15.867780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.934152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 480/968] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:15.936429 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:15.952418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.019769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17370c1-05c0-4050-84b1-58416ead00b6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.058686 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.066963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319c3e-8e7c-40f8-bb7f-386a7e6023de None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.075500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.076255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.076610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.076982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.077836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.079287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.112990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 489/969] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:16.124646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.125626 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.126042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.126406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.139235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.140715 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:16.164505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:16.165514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:16.166392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:16.166392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:16.166392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:16.166392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:16.166932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 481/970] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:16.173461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.298443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900181-7e76-46a4-ab8d-fd6d74d1e691 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.321443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.339260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.339938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.340223 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.340550 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.341434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.341746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.343162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ac98-4483-43a4-9265-ba926e21c4a3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.356195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 490/971] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:16.362642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.472219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f75c-4393-479e-94a3-cdd8000743f8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.509322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.510131 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.510417 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.510696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.518228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.520980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.523455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41322-8f00-4cab-882c-a5417cc3824c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.523753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41322-8f00-4cab-882c-a5417cc3824c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.524034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41322-8f00-4cab-882c-a5417cc3824c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.525866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 491/972] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:16.538346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.538975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.539481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:16.545406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:16.546295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:16.547173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 482/973] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:16.554362 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.558816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.561445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:16.562877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:16.645735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 492/974] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:16.673187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.691330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37272d47-5999-4a7d-b3bd-2631cf05f940 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.736425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.738263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.738630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.739187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.740020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.740507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.742627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.757325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 483/975] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:16.766186 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.790273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6d109-b952-4a5c-962e-7cc501318857 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.801993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.828227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.829082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.829433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.829780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.831083 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.832596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.834007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING keystone.server.flask.common [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:27:16.848772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:16.849014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.sql.core [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:16.849014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:27:16.849014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [parameters: {'user_id': 'c96c0bc7d00245a39011eeb7c4571c7c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:27:16.849014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:16.857396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:16.858357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application yield resource Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise self.value Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application session.commit() Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:27:16.859318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:27:16.860203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:27:16.861147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application result.read() Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:27:16.862141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c96c0bc7d00245a39011eeb7c4571c7c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:16.864095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 14:27:16.870637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 493/976] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Jul 11 14:27:16 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:16.872802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:16.911811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c141-2375-477a-b05b-b2ac1aa571d0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:16.947335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:16.948030 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:16.948279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:16.948554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:16.949447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] RBAC: Adding query filter params (role.id=8d9cf4d2b87d479b9245a95170160f2d, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=22a8f4b7fb6e4783aac4f34e57ec19fc) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:16.949761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:16.951337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:16.958253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 484/977] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/role_assignments?user.id=22a8f4b7fb6e4783aac4f34e57ec19fc&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=8d9cf4d2b87d479b9245a95170160f2d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:16.997857 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae4a9b-8b6f-49a4-bb5a-f414e10e8907 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.045390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.046553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.047022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.047472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.057829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.060639 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-4890ae4e-c8fc-454b-b15a-cbd23c60ac8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:17.079975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:17.081631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:27:17.082607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:17.089105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 494/978] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:17.094002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.215058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca198-27af-4225-bca1-9bfe542737f9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.255469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.261265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.261941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.262224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.262500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.263408 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:17.263719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.265160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c80160-ab4c-4c1f-8c54-605705878cc4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.301932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 485/979] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Jul 11 14:27:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:17.623286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659569f-cab1-41b2-a387-d1691611b400 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.623664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659569f-cab1-41b2-a387-d1691611b400 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.623868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659569f-cab1-41b2-a387-d1691611b400 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.628886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 495/980] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:17.633857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e3fc-f406-48c2-97c6-64ab1b566a1a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.634151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e3fc-f406-48c2-97c6-64ab1b566a1a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.634428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585e3fc-f406-48c2-97c6-64ab1b566a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.652802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-4585e3fc-f406-48c2-97c6-64ab1b566a1a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:17.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-4585e3fc-f406-48c2-97c6-64ab1b566a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:17.724520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 486/981] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:17.747112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659569f-cab1-41b2-a387-d1691611b400 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:17.783225 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:17.869093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659569f-cab1-41b2-a387-d1691611b400 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:17.907265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:17.907928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:17.908224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:17.908490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:17.910061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:17.911433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb403e-9707-4186-a642-49e2fd85a141 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:17.936881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 496/982] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:17 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:18.339710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc181-3686-45b1-9e2f-8d0bcf39ce25 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.340077 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc181-3686-45b1-9e2f-8d0bcf39ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.340286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cc181-3686-45b1-9e2f-8d0bcf39ce25 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.341837 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 487/983] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:18.347460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.347760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.348048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.364914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:18.366461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:18.439762 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 497/984] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:18.462620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cc181-3686-45b1-9e2f-8d0bcf39ce25 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.570044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cc181-3686-45b1-9e2f-8d0bcf39ce25 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.587447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.606873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.607608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.607894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.608172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.608835 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.610239 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:18.622261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:18.623248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:18.624095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:18.629005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 488/985] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:18.630237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.649797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:18.733233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74e1dc-88f4-408a-a012-600195e52d07 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.767759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.769165 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.769273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.769591 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.770266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:18.770575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.771935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.782250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 498/986] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:18.783202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:18.883846 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf05518-9d3a-48b7-b434-2a077e3fd5dd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:18.918119 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:18.918785 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:18.919074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:18.919357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:18.920079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:18.920392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:18.921781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:18.933894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 489/987] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:18.934065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.019547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.041977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b02a2-d0e9-4cb4-9590-19aca660d9e3 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.077797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.078464 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.078753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.079037 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.079847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] RBAC: Adding query filter params (interface=admin, service_id=c6f21421bb8b4033a91e1b514a44756a, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:19.080167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.082064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d4114-0489-46ec-ad4a-7c411dc2e1f8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.091597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 499/988] 10.222.0.73 () {56 vars in 1249 bytes} [Mon Jul 11 14:27:18 2022] GET /identity/v3/endpoints?service_id=c6f21421bb8b4033a91e1b514a44756a&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:19.093158 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.110711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b66c2-d28a-4797-89f2-1e8d777cd122 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.111054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b66c2-d28a-4797-89f2-1e8d777cd122 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.111279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b66c2-d28a-4797-89f2-1e8d777cd122 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.112749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 500/989] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:19.117959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.118243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.118520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.136823 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:19.137990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:19.154485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.209324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 501/990] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:19.219639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eb978-6b1f-4119-acbc-73eb6f7b7079 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.231843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.258091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.258757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.259057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.259324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.260016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.261413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.277113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 490/991] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:19.320467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.346987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cbcd8-a750-40db-ad6f-cd5630d40f45 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.383387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.384203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.384492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.384765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.385534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.386982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:19.399851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:19.400934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:19.401783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 502/992] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:19.410202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.519502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d637800-9954-41b4-98d5-37f5d3337c8b None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.529496 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:19.554755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.555425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.555716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.555997 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.556712 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] RBAC: Adding query filter params (name=image) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:19.557054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.558436 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83305059-fb5a-4570-84ca-e628f34b98dc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.568584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 491/993] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:19.569956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:19.674413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410af015-2c1a-4296-9e5b-dd7f2123a79e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:19.708734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:19.709430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.709715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.709992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.710710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:19.711024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:19.712385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8e3bd-61f2-47d8-8476-2d5cf74faf9e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:19.717220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 503/994] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:19.975263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35791-8906-4846-a145-0e03c5642b35 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.975757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35791-8906-4846-a145-0e03c5642b35 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.975850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d35791-8906-4846-a145-0e03c5642b35 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.977353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 492/995] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:19.982231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:19.982745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:19.982826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:19.988840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.001106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:20.002345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:20.069257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 504/996] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:20.091633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d35791-8906-4846-a145-0e03c5642b35 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.200025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d35791-8906-4846-a145-0e03c5642b35 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.235569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.236341 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.236632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.236952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.237668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.239036 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:20.250985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:20.251956 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:20.253761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 493/997] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:20.258511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.360520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4af54-8da5-40f8-b087-f017f91221cb None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.395420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.396092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.396382 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.396659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.397401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.397712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.399078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.400236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.410987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 505/998] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.412291 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.448739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.523600 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291b970-474c-497d-923c-c98ab0f70e72 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.556270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.557020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.557305 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.557579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.558284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.558588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.559937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.564831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 494/999] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:20.570996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.667694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586dbd4-461e-40ba-9cdb-086ca8ed091c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.701230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.701848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.702132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.702405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.703201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] RBAC: Adding query filter params (interface=public, service_id=1a7a4f69068647aea723218e36b38922, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:20.703509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.704878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d681c-decd-4158-9e84-96380b9660ab None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.710096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 506/1000] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/endpoints?service_id=1a7a4f69068647aea723218e36b38922&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:20.715330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:20.814112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:20.817776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2d0f-5df1-4260-846e-88f6113238f7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:20.854482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:20.855144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:20.855425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:20.855700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:20.856382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:20.857767 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7abea-00bb-4b58-9dcb-c19c5c56056a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:20.869278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 495/1001] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:20 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:21.369219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a787e-ccef-48e1-841e-5c44df7fdc68 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.369786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a787e-ccef-48e1-841e-5c44df7fdc68 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.369786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a787e-ccef-48e1-841e-5c44df7fdc68 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.371308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 507/1002] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:21.376233 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.376649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.376825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.393993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:21.395185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:21.467636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 496/1003] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:21.490734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a787e-ccef-48e1-841e-5c44df7fdc68 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.554093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.594835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a787e-ccef-48e1-841e-5c44df7fdc68 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.629687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.630933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.631431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.631927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.633026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.634396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-0673d713-cdcc-474f-b4b1-cd620f7f83de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:21.648519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:21.649620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:21.650498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 508/1004] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:21.656195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.751490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:21.758975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e36dd-6538-4db6-ac36-9613f7bf8dd9 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.793558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.794256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.794516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.794798 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.795517 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:21.795772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccb1d-70c3-4fa3-9e29-a5ea8ce6d636 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.795871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.796068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccb1d-70c3-4fa3-9e29-a5ea8ce6d636 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.796355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ccb1d-70c3-4fa3-9e29-a5ea8ce6d636 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.797325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.797893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 509/1005] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:21.807224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 497/1006] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:21.807370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.807370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.807370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.808685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.823579 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:21.824781 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:21.896672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 510/1007] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:21.917188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac035054-4111-410e-aa60-8eabc1798888 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:21.919043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.953565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:21.954234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:21.954522 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:21.954800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:21.956065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:21.956378 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:21.957792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:21.968247 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 498/1008] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Jul 11 14:27:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:21.969731 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:21.994002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.001265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:22.042178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c48f4-6b4c-4fe7-86d0-9a79eb3afb14 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.079597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.080255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.080586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.080876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.081562 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.082916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b14d94-4fbf-4880-b1ac-7c8b5da560f1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.083016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdebc5-482f-4dc6-8a3d-15addc66ee0f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:22.098534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 511/1009] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:21 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:22.129695 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:22.130375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.130662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.130940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.131698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:22.133133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f3397-8761-431b-bc76-db055bb3a725 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:22.150379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 499/1010] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:22.931815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4168b-73da-4e49-b30b-adec476f85cf None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.932331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4168b-73da-4e49-b30b-adec476f85cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.932331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4168b-73da-4e49-b30b-adec476f85cf None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.933745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 512/1011] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:22.938725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:22.939098 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:22.939279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:22.956625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:22.957860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:23.032002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 500/1012] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:23.055558 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4168b-73da-4e49-b30b-adec476f85cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.162444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4168b-73da-4e49-b30b-adec476f85cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.179950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.200011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.200740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.201069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.201353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.202012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.203372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:23.215078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:23.216063 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:23.216920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 513/1013] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:23.222803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.225962 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.329840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c96d3-d454-4866-b33c-c8129f4af2f3 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.363965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.364631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.364943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.365223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.365961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:23.366324 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.367709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.376943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 501/1014] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:23.378939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.485930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056be7c-cbd3-4103-8940-855981404590 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.520162 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.520832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.521145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.521423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.522136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:23.522445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.523798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8b71-dd2d-4885-b3d7-8398e8eb85a7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.529133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 514/1015] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Jul 11 14:27:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:23.535461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:23.602801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:23.637075 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11615298-55da-47e4-b1c7-0167a68b5e1f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:23.672621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:23.673310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:23.673597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:23.673878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:23.674653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:23.676008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0fff3-1810-4cb4-9166-4cb9272ef42e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:23.704876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 502/1016] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:24.168076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9157-3cab-4b0d-8aff-c52a6fac4cbb None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.168594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9157-3cab-4b0d-8aff-c52a6fac4cbb None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.168673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d9157-3cab-4b0d-8aff-c52a6fac4cbb None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.170336 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 515/1017] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:24.175666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.176094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.176266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.193796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:24.194980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:24.229027 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725c96-9b6a-4d7f-be28-184728cbd748 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.229406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725c96-9b6a-4d7f-be28-184728cbd748 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.229596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725c96-9b6a-4d7f-be28-184728cbd748 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.231085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 516/1018] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:24.236213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.237059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.237341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.254610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:24.255797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:24.277002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 503/1019] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:24.296603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.297182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.332293 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 517/1020] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:24.350804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.351585 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.407657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0d09c-b71a-4ef1-83a6-586c00ebdfe2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.443658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.444370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.444659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.444969 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] PATH_INFO: `/v3/services/image` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.445641 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.447026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:24.458704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:24.459895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:24.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 504/1021] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:24.462601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c7471-94fb-46fc-859d-edb377ce30e3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.465673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.506138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.506936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.507230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.507498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.508671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.510113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.511888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 518/1022] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:24.517559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.563731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.576204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaadb88-c335-49d7-bfad-4fc98457f540 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.589786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.610533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.611199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.612009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.612293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.613044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] RBAC: Adding query filter params (name=image) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.613356 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.614729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.619799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 505/1023] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:24.625017 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.630707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb820c-9a8e-466e-b063-277cba264b9f None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.669043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.669716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.670008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.670290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.671329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.672771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.708969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 519/1024] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:24 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:24.733171 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959874-cb84-4152-8af7-ee8342815470 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.776471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.777450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.777738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.778013 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.778742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] RBAC: Adding query filter params (type=image) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.779051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.780438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.786126 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 506/1025] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:24.792178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:24.898000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:24.907165 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44882d-3ae0-4b5c-8d5c-dcdb7e4ca011 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:24.943036 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:24.943709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:24.943992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:24.944268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:24.945100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] RBAC: Adding query filter params (interface=public, service_id=f4929cac06a748d3b1751aef11989709, region_id=RegionOne) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:24.945412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:24.946775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a450a-1cdd-4040-a21c-1d8d98c8bca1 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:24.956917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 520/1026] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/endpoints?service_id=f4929cac06a748d3b1751aef11989709&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:24.958687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:25.003257 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:25.066490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79da85-d938-4045-b4fc-ddaaef440280 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:25.105720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:25.106720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.107172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.107598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.108442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:25.109988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95bcaa-1f06-4d94-a2ce-42bd7d564662 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:25.124986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 507/1027] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:27:24 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:27:25.850252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576da9e-e95a-40ca-9ebb-3285da261cf6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.850252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576da9e-e95a-40ca-9ebb-3285da261cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.850252 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576da9e-e95a-40ca-9ebb-3285da261cf6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.851171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 521/1028] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:25.856215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:25.856593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:25.856781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:25.874656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:25.876055 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:25.944964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 508/1029] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:25.968097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576da9e-e95a-40ca-9ebb-3285da261cf6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.070796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576da9e-e95a-40ca-9ebb-3285da261cf6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.104547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.105384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.105668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.105941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.116360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:26.124381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:26.125359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:26.126192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:26.128142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 522/1030] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:26.132046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.166252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.237718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a371b-0b46-48d7-a499-ab8b2aa62e2e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.273084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.273740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.274021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.274293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.275056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:26.275354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.276975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.291445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 509/1031] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:26.293391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.314122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.394947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e171e2-2528-4f36-a942-f048ed078498 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.428946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.429737 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.430017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.430289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.440784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.442236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:26.459155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:26.460054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:26.465640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:26.465640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:26.465640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:26.465640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:26.465640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 523/1032] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:26.467468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.568033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.572800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537214c-053e-43d7-85c1-1c9f0091fa48 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.609963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.610629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.610916 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.611197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.611977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:26.612288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.613704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.625331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 510/1033] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:26.630855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.702571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.735668 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e157-c626-4b8b-8648-f310c1ca9647 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.770239 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.771033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.771322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.771596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.779588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.781046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b636230a-6f2e-4056-a48b-8e90eb20a021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:26.795094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:26.796035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:26.802211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 524/1034] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:26.804640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.810797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12960b-4bd1-48fd-9644-51396f9eb6b4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.811084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12960b-4bd1-48fd-9644-51396f9eb6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.811361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12960b-4bd1-48fd-9644-51396f9eb6b4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.812887 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 525/1035] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:26.818250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.818539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.818817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.835373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:26.836547 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:26.906824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 526/1036] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:26.914500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9e88c-435d-44c9-9db3-5e1f941624a9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:26.931938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.949718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:26.950491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:26.950778 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:26.951052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:26.951890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:26.952198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:26.953832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:26.976917 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 511/1037] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:26.977902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:26.994623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:26.997614 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.038777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8134e-fcb5-4016-a0dd-580368ee92e1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.080084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.081874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.082381 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.082867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.086177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.088095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 527/1038] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:27.093580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67c0c-7637-490c-9926-fa4de7c865ff None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.094840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.131629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.132372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.132632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.133062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.206257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446aaf7-0aac-4576-909d-57a0e2c1f7db None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.213554 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.214993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.231484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.233033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.242701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.243374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.243658 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.243935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.244651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.246098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4632b0-1d07-4ed0-bb62-b16ee823734f None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.266948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 528/1039] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:27:27 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:27.268347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86dd6-35e6-4877-9075-ceeba1ebe3cd None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.268638 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86dd6-35e6-4877-9075-ceeba1ebe3cd None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.268936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86dd6-35e6-4877-9075-ceeba1ebe3cd None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.270186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 529/1040] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:27.276003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.276285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.276564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:27.296416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:27.331810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 512/1041] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:27.333049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.377863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 530/1042] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:27.401918 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.452148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d598a84-6e85-48ff-b729-aefc06d81723 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.470405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.495664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.496459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.496743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.497047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.507545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.509016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.524292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85cc4-5ff1-4cd5-b9af-299269b8d9d0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:27.528005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:27.528952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:27.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:27.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:27.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:27.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:27.529843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 513/1043] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:27.536321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.541178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.570260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.571096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.571386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.571717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.572395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.574894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:27.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:27.591542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:27.592388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 531/1044] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:27.598751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.647204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1494-1b65-4560-a95e-e2de505d4017 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.683482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.684213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.684510 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.685718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:27.686080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.687524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.697289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc174da-123f-43ea-bc0b-e1d653e893fe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.705102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 514/1045] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:27.706740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.732194 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.732910 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.733202 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.733477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.735103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] RBAC: Adding query filter params (name=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:27.735103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.735835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.739537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.741506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 532/1046] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:27.746893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.791230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.824589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dc069-cdfa-4390-9d21-2d6cc0271e97 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.852067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc8ac4-8f44-4b22-9f34-f43c4d3c34eb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.858084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.858945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.859233 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.859522 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.866292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.867843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:27.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:27.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:27.887208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:27.889154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 515/1047] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:27.889509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.890317 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.890548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.890826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.891571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] RBAC: Adding query filter params (type=image) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:27.891876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.893815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.895370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.899543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 533/1048] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:27.904628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.989947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.003413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5676d-d022-4371-9f67-56bda5a429a1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.019621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85171e47-8fd1-423e-9e43-1dddae1d56af None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.027904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:28.039935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.040592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.041046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.041156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.041945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:28.042251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.043665 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.060890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 516/1049] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:28.061951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:28.063332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.064004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.064295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.065161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.066107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.068428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e3c9a-b27d-433e-83ad-5305c5e9176e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.088197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 534/1050] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:27:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:28.183915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca142ac-a12d-42a9-806a-6a7cc2995d5f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:28.226998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:28.228029 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:28.228544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:28.229068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:28.230120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] RBAC: Adding query filter params (role.id=8d9cf4d2b87d479b9245a95170160f2d, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:28.230740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:28.232431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee34b4-a6a1-4085-ba97-25b115b4a78c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:28.240365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 517/1051] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:28 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=8d9cf4d2b87d479b9245a95170160f2d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:29.367920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1a26-e77c-46f3-a4af-219a4b4a2330 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.368470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1a26-e77c-46f3-a4af-219a4b4a2330 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.368470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d1a26-e77c-46f3-a4af-219a4b4a2330 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.370044 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 535/1052] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:29.375149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.375586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.375678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.393637 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:29.394824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:29.397065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.467866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 518/1053] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:29.491319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1a26-e77c-46f3-a4af-219a4b4a2330 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.597216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d1a26-e77c-46f3-a4af-219a4b4a2330 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.632884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.633661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.633955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.634236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.644541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:29.654459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:29.655388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:29.656208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:29.661211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 536/1054] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:29.662840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.763546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5a1b5-03cd-4c17-8695-cdd19201e37e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.800227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2859-2993-4435-9744-ff17455268ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.800928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2859-2993-4435-9744-ff17455268ce None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.801218 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2859-2993-4435-9744-ff17455268ce None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.801546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2859-2993-4435-9744-ff17455268ce None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.802252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2859-2993-4435-9744-ff17455268ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:29.802559 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2859-2993-4435-9744-ff17455268ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.803985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2859-2993-4435-9744-ff17455268ce None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.809416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.817022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 519/1055] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:29.820594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:29.845975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:29.928034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d4d-9ff6-46e4-b817-18832c6b5c68 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:29.962108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:29.962991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:29.963271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:29.963540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] PATH_INFO: `/v3/users/6b03074c6eeb43e0bee8c22bff261754` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:29.977036 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] RBAC: Authorizing `identity:get_user(user_id=6b03074c6eeb43e0bee8c22bff261754)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:29.978458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6673dab-14e8-4599-82ce-a5a8768ba718 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:29.980312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 537/1056] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/users/6b03074c6eeb43e0bee8c22bff261754 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:29.985794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2859-2993-4435-9744-ff17455268ce None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.089781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2859-2993-4435-9744-ff17455268ce None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.122536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.123187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.123468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.123742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.179930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7007a7-9204-49cf-b0cc-1b7dc42accd3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.180127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7007a7-9204-49cf-b0cc-1b7dc42accd3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.180413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7007a7-9204-49cf-b0cc-1b7dc42accd3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.181962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 538/1057] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:30.186912 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aafb-198f-409a-8f90-3f91d8eb3453 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.187206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aafb-198f-409a-8f90-3f91d8eb3453 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.187493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aafb-198f-409a-8f90-3f91d8eb3453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.192627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.197810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.199262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.205736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d708aafb-198f-409a-8f90-3f91d8eb3453 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:30.206989 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d708aafb-198f-409a-8f90-3f91d8eb3453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:30.278434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 539/1058] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:30.279746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f25ce-8189-4c97-97e4-e79012a4702b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.280039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f25ce-8189-4c97-97e4-e79012a4702b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.280316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f25ce-8189-4c97-97e4-e79012a4702b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.281617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 540/1059] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:30.290459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.290756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.291037 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.307797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:30.308993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:30.310002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 520/1060] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:30.310827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.311906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.380424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 541/1061] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:30.382051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.413726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.416650 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b845f3-d59a-419b-beda-a5ceb318fa92 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.452081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.454022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.454022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.454022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.489172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e4ad1-66e3-495c-a113-31809a155123 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.520580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.522076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.522233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.523091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.523375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.523651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.524824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.526256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.528227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 542/1062] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.529002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.542961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.617009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.626167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 521/1063] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:30.626167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.632350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c9da-21c9-4169-a371-0a6b6306e16c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.668161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.668994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.669281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.669554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.680375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:30.688740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:30.689748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:30.690578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 543/1064] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:30.691316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.730771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f4dc8-b42e-4924-b19f-3bf5c4563efa None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.756977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.764529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.765210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.765488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.765763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.766597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user.id=6b03074c6eeb43e0bee8c22bff261754) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:30.766907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.768518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.774005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 522/1065] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/role_assignments?user.id=6b03074c6eeb43e0bee8c22bff261754&scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.774773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.805736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f8311-ff0e-4137-91c3-34d221950879 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.844077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.844962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.846031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.846662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:30.858885 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.860449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:30.881366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:30.882373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:30.883265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:30.883265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:30.883265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:30.883265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:30.883265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 544/1066] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:30.888798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:30.890181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba419-1b19-4b6d-a2d9-88a0a4c49686 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:30.929814 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:30.930483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:30.930772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:30.931044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:30.931799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:30.932106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:30.933504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:30.950292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 523/1067] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:30.951703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.012266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21fa18-d32d-4fdd-bb2f-a7a651328c0a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.035585 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.052222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.053014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.053306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.053590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.054327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.054641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.056003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.060465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ad9c5-de01-409b-bc7b-a41871e07c8c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.080888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 545/1068] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:31.089512 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.100449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.101322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.101607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.101881 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.114282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.115741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:31.134579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:31.135540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:31.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:31.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:31.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:31.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:31.136416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 524/1069] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:31.141868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.262411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c4f51-1e79-4c52-af9b-07d2715ab055 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.299899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.300473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.300766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.301128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.302315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.302315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.303560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.316069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 546/1070] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.322087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.427425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772fb61-bc2a-4e4b-a3e1-7e4d12ca34d0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.460342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.461167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.461455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.461730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.469505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.471476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:31.488805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:31.489764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:31.490684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 525/1071] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:31.495868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.537823 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.594155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0c611-a8cc-4812-99c4-19a511e98ded None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.629947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.630608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.630900 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.631176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.632017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.632331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.633780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.650386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 547/1072] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.656269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.695605 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.753800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472897de-c171-4b3a-b154-ad6f2a1c2ecc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.787208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.788035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.788264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.788534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.798453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.799915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:31.817438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:31.818322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:31.819199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:31.819199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:31.819199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:31.819199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:31.819199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 526/1073] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:31.824361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:31.921857 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:31.926122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63051d9b-0903-4fa8-a88f-5716f2380efe None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:31.960629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:31.961319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:31.961604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:31.961879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:31.962602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:31.962910 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:31.964268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:31.975805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 548/1074] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:31.981591 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.068676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.079314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e469bc9-0b65-4008-94f9-8a89487f30bc None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.112579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.113387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.113672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.113946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.120365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.121832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:32.135738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:32.136598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:32.137688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 527/1075] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:32.143286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.239410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd3b7b-99c6-4a1f-b532-f7d5ee259acb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.272707 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.273397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.273678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.273952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.274759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:32.275396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.276469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2913-dfa4-4935-840c-5bb9396cd661 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.289159 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 549/1076] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:32.294996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.393418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5f10-462e-4f2d-9998-fa3666774cb9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:32.427090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:32.427974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.428503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.428674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/8d9cf4d2b87d479b9245a95170160f2d` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.430894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=861c2da914694e319257102a0fd2f19f, role_id=8d9cf4d2b87d479b9245a95170160f2d)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:32.432313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f16ed-5d59-4ef4-9527-541a52602a20 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:32.445620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 528/1077] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:32 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/861c2da914694e319257102a0fd2f19f/roles/8d9cf4d2b87d479b9245a95170160f2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:32.813416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f5f2-7c44-4e59-8a91-762cdebc6b46 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.813944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f5f2-7c44-4e59-8a91-762cdebc6b46 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.813944 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f5f2-7c44-4e59-8a91-762cdebc6b46 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.815968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 550/1078] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:32.821212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:32.821509 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:32.821792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:32.838641 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:32.839841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:32.842630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:32.907255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 529/1079] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:32.930690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f5f2-7c44-4e59-8a91-762cdebc6b46 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:32.949286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.029946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f5f2-7c44-4e59-8a91-762cdebc6b46 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.063748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.065028 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.065314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.065590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.075438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:33.083574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:33.084673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:33.085829 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 551/1080] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:33.090875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.194441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00408b7-26d3-4478-821d-9075bd8d5c56 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.234280 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.234753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.235032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.235302 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.236565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:33.236905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.238244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.246189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 530/1081] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.252696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.328318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.349233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea772d4-a2cd-49f6-8282-b0ed01d41076 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.382209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.383075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.383358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.383632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] PATH_INFO: `/v3/users/6b03074c6eeb43e0bee8c22bff261754` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.384810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] RBAC: Authorizing `identity:get_user(user_id=6b03074c6eeb43e0bee8c22bff261754)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.386248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.387877 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 552/1082] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/users/6b03074c6eeb43e0bee8c22bff261754 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.394386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.398278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:33.497008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52303c-feb7-43fe-b4eb-1f6feec75d92 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.529990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.530855 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.531200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.531404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.532574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.534056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eda734-a14f-4476-b37f-250276c750fa None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.535746 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 531/1083] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:33 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:33.541626 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:33.642385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec98b3-8b7d-4fae-a2b2-98a4cb4e70cb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:33.675430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:33.676309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:33.676600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:33.676912 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c/users/6b03074c6eeb43e0bee8c22bff261754/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:33.678867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user_id=6b03074c6eeb43e0bee8c22bff261754, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:33.680296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84c900-9a8e-41b7-b1c6-a32aea4c8bb5 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:33.698575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 553/1084] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:33 2022] PUT /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c/users/6b03074c6eeb43e0bee8c22bff261754/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:27:34.489558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cb59-6787-4157-886f-407074197ab7 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.489852 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cb59-6787-4157-886f-407074197ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.490134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cb59-6787-4157-886f-407074197ab7 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.491526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 532/1085] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:34.496751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.497192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.497346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.509357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.514709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:34.516430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:34.584024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 554/1086] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:34.607412 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0cb59-6787-4157-886f-407074197ab7 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.676497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.710130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0cb59-6787-4157-886f-407074197ab7 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.747899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.748620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.748931 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.749205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.759860 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:34.768384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:34.769525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:34.770358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 533/1087] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:34.776097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:34.873223 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d6c0-3980-41b1-a17c-6073a1572a9f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:34.906782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:34.907440 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:34.907721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:34.908128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:34.908893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:34.909203 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:34.910543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:34.912782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:34.919695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 555/1088] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:34.925924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.022525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0cbaa-299c-44cb-a1cb-ff7448cb019e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.049944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.056095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.056896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.057181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.057453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.068352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.069799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:35.086355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:35.087398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:35.088306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:35.088306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:35.088306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:35.088306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:35.088306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 534/1089] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:35.093320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.215702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd12a-dc94-460d-892e-880f7ca4e1d8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.256767 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.257480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.257772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.258055 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.258793 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:35.259104 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.260467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.273305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 556/1090] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:35.278868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.383945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122046b9-7547-4889-b34a-5b4cf3763525 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.422169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.422967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.423256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.424093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.431656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.433113 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:27:35.446844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:35.447974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:35.448982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 535/1091] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:35.454051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.513377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.555609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2076-5d38-4e2d-b9bf-2636aa80db14 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.589487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.590156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.590438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.590712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.591552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:35.591857 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.593298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a3ba-cb1c-420a-9a5a-0680fc4bf289 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.611009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 557/1092] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:35.616748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.664833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.709354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65330-ff6b-4649-9343-469e1d5f5214 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.709647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65330-ff6b-4649-9343-469e1d5f5214 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.709934 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65330-ff6b-4649-9343-469e1d5f5214 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.711338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 558/1093] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:27:35.716071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.716362 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.716644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.722125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583fa36-c201-4a23-8d77-c26db7e0f969 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.734494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:35.735697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:35.756592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.757261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.757550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.757829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.811078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 559/1094] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:35.826516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:35.828015 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:35.834846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.869886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.880213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:35.927622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 536/1095] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:35.932592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1e10d-30f7-4abf-a3d3-245f3d30b5dc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:35.933314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:35.966800 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:35.967587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:35.967872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:35.968146 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:35.977930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:35.985569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:35.986688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:35.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 560/1096] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:35.992663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.033960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76493a-094c-40a8-aaaf-2f2146385787 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.069180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.069906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.070189 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.070466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.081353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.082881 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.084646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.093628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2fce-0843-4b10-b61f-36d72b5c3875 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.102219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:27:36.102390 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:36.103367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:36.104527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:27:36.104527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:27:36.104527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:27:36.104527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:36.104527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 537/1097] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:36.110622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.137312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.137981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.138268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.138555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.139383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.139704 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.141093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.149675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 561/1098] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:36.156054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.210156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c859-18c9-4763-81a4-3a6ebfa163f9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.243690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.244343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.244625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.244933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.245662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.245966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.247310 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.254484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfcb25-631b-4fdf-91c2-863e20a6d4d9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 538/1099] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:36.264556 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.290024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.290895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.291179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.291472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] PATH_INFO: `/v3/users/6b03074c6eeb43e0bee8c22bff261754` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.292677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] RBAC: Authorizing `identity:get_user(user_id=6b03074c6eeb43e0bee8c22bff261754)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.294138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.295954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 562/1100] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/users/6b03074c6eeb43e0bee8c22bff261754 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:36.301964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.322106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.336500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.366568 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d046b7-8b7c-4ced-98fb-0532ab0bcbb4 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.400586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b922-56da-461f-b90d-2304081d4b14 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.401080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.402132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.402425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.402698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.410243 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.411703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:27:36.426526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:36.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:27:36.428444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 539/1101] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:27:36.433430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.433969 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.434621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.434908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.435181 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.504416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.505966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.533933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271bc0a-e73d-4055-a492-2f839de3d5a7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.541245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.547915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.568781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.569540 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.569829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.570110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.570908 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.571224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.572711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.584646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 540/1102] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:36.590774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.606699 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 563/1103] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:27:36.612521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.691210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3732093-dad6-4558-aacf-6933871b2fd8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.709280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2cad-4d15-40ab-b68d-3a685b2b884d None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.725462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.726115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.726402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.726678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.727521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] RBAC: Adding query filter params (role.id=8d9cf4d2b87d479b9245a95170160f2d, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=861c2da914694e319257102a0fd2f19f) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.727838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.729318 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.735132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 541/1104] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/role_assignments?user.id=861c2da914694e319257102a0fd2f19f&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=8d9cf4d2b87d479b9245a95170160f2d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:36.742218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.743099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.743385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.743659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.744952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.746411 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509084-dd69-4412-8377-22fca2dc1432 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.748215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 564/1105] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:27:36.755303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:36.798356 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:36.862484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a81c5-1791-45c2-8297-4d3fdd4c91e0 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:36.898653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:36.899315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:36.899603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:36.899886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:36.900732 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user.id=6b03074c6eeb43e0bee8c22bff261754) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:36.901091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:36.902769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99626f59-e87c-4cb4-9b2b-9bdf65a97234 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:36.909261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 542/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:36 2022] GET /identity/v3/role_assignments?user.id=6b03074c6eeb43e0bee8c22bff261754&scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:38.984670 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a74ba6-b87b-46d6-972d-24b393581a99 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.985242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a74ba6-b87b-46d6-972d-24b393581a99 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.985242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a74ba6-b87b-46d6-972d-24b393581a99 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:38.987277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 565/1107] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:38.992544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:38.993170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:38.993170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:39.010733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:39.075014 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 543/1108] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:39.099594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a74ba6-b87b-46d6-972d-24b393581a99 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.103425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.204466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a74ba6-b87b-46d6-972d-24b393581a99 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.237677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.238387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.238671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.238945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.240135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.241592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62f95e-d596-4647-adf9-2ac9d26fbf29 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.243227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 566/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:39.249039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:39.284598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:39.351606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4fe60-af9c-41f3-a23a-dc9b9c97af9b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:39.383623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:39.384281 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:39.384562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:39.384835 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:39.385573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:39.387090 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89425d9-8744-4f0d-bdf4-6a0427bc0c47 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:39.407489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 544/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:27:39 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:27:41.463555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f32f-f077-4221-96ed-a67f39c42fd1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.465407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f32f-f077-4221-96ed-a67f39c42fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.465407 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f32f-f077-4221-96ed-a67f39c42fd1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.465603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 567/1111] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:41.471125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.471521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.471676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.488644 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:41.489850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:41.554440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 545/1112] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:41.577431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f32f-f077-4221-96ed-a67f39c42fd1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:41.647015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:41.676902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f32f-f077-4221-96ed-a67f39c42fd1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:41.708993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:41.709839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.710122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.710398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] PATH_INFO: `/v3/roles/7f83d786d22243dab58a39a437993025` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.711858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] RBAC: Authorizing `identity:get_role(role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:41.713250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:41.714675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 568/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:41 2022] GET /identity/v3/roles/7f83d786d22243dab58a39a437993025 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:41.720963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:41.738617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:41.817076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4b5dd-5c42-415c-955f-6e5e88b33f6e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:41.851041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:41.851898 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:41.852184 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:41.852463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] PATH_INFO: `/v3/users/e9319052047e432b8fbd3348374b9003` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:41.868211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] RBAC: Authorizing `identity:get_user(user_id=e9319052047e432b8fbd3348374b9003)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:41.869728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:41.871902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 546/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:41 2022] GET /identity/v3/users/e9319052047e432b8fbd3348374b9003 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:41.878314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:41.976436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979a0f-04f1-4ee2-ab1e-373f353a3343 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.009952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.010597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.010882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.011158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.022261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.082504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:42.083939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:42.179522 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 569/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:42.185690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.261620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.284489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5daa30-8629-459e-9259-c3207ef2c090 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.320690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.321584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.321871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.322149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.323343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:42.324797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff025b-85fb-4c89-8da4-ae84e3acb123 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:42.326560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 547/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:42 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:42.333073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:42.378487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:42.436372 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc7769-c57c-436e-afd2-d102fc3c3fb7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:42.470553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:42.471224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:42.471502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:42.471776 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:42.472625 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user.id=e9319052047e432b8fbd3348374b9003) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:42.472974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:42.474405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85556-57ac-4b12-bab9-3f466d5edcc0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:42.480271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 570/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:42 2022] GET /identity/v3/role_assignments?user.id=e9319052047e432b8fbd3348374b9003&scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c&role.id=7f83d786d22243dab58a39a437993025 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.474854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f366-fbe8-4771-b592-8704061ebb18 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.475398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f366-fbe8-4771-b592-8704061ebb18 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.475398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6f366-fbe8-4771-b592-8704061ebb18 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.476800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 548/1118] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:44.482256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.482651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.482808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.499925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:44.501131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:44.568482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 571/1119] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:44.591806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f366-fbe8-4771-b592-8704061ebb18 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.693920 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6f366-fbe8-4771-b592-8704061ebb18 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.728238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.728522 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.728796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] PATH_INFO: `/v3/roles/7f83d786d22243dab58a39a437993025` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.730344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] RBAC: Authorizing `identity:get_role(role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.731705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.733107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 549/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/roles/7f83d786d22243dab58a39a437993025 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.739179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.771985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.838335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b542d-002e-40f3-8cc0-a03964332200 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:44.870563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:44.871420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:44.871710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:44.871985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] PATH_INFO: `/v3/users/e9319052047e432b8fbd3348374b9003` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:44.873190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e9319052047e432b8fbd3348374b9003)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:44.874596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:44.876981 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 572/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/users/e9319052047e432b8fbd3348374b9003 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:44.882989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:44.897301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:44.982317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d81ae-62ed-49b3-84ac-7c5c1672ad3e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.016546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.017499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.017800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.018063 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.019290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.020685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b8db-115d-40b8-8f45-b2a74c885ca5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.022407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 550/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:44 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:45.029196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:45.141299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdc4f-e10a-465e-ba70-d544694d9dd4 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:45.143138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:45.178561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:45.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:45.179745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:45.180024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c/users/e9319052047e432b8fbd3348374b9003/roles/7f83d786d22243dab58a39a437993025` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:45.182231 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user_id=e9319052047e432b8fbd3348374b9003, role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:45.183656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e602f-4165-409d-9b84-275b9a818b99 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:45.197199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 573/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:45 2022] PUT /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c/users/e9319052047e432b8fbd3348374b9003/roles/7f83d786d22243dab58a39a437993025 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:47.178132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be402d-737f-4209-bcd0-93066685eab1 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.178675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be402d-737f-4209-bcd0-93066685eab1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.178675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be402d-737f-4209-bcd0-93066685eab1 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.180057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 551/1124] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:47.185289 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.185671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.185854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.202826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:47.205136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:47.269140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 574/1125] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:47.293474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be402d-737f-4209-bcd0-93066685eab1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.387504 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.407977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be402d-737f-4209-bcd0-93066685eab1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.441115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.441905 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.442192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.442471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] PATH_INFO: `/v3/roles/7f83d786d22243dab58a39a437993025` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.443967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] RBAC: Authorizing `identity:get_role(role_id=7f83d786d22243dab58a39a437993025)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.445361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.446741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 552/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/roles/7f83d786d22243dab58a39a437993025 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.452555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.540341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.549769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7f55-92c2-40f8-ab3c-f361baa2f981 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.582923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.583783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.584064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.584338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] PATH_INFO: `/v3/users/e9319052047e432b8fbd3348374b9003` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.585525 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] RBAC: Authorizing `identity:get_user(user_id=e9319052047e432b8fbd3348374b9003)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.586940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.588566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 575/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/users/e9319052047e432b8fbd3348374b9003 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:47.594445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.690648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a12b-3970-46c0-adb3-8f9beab950ab None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:47.724046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:47.724618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:47.724929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:47.725217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:47.742004 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:47.790129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:47.791640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:47.886761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 553/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:27:47.892841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:47.990270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47043-172c-4f90-8e1a-7090b46d416c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:48.027889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:48.028757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.029073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.029356 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] PATH_INFO: `/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.030571 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3bb0382fcd4eedbfeaf6cb277efb4c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:48.032019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31537d-23aa-4205-9e6b-29e63c8dba15 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:48.034396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 576/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:47 2022] GET /identity/v3/projects/9b3bb0382fcd4eedbfeaf6cb277efb4c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:48.040752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:48.089879 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:48.145815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41dfd-757e-461e-829f-7c3b157c9fe3 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:48.180197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:48.180833 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:48.181145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:48.181420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:48.182260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] RBAC: Adding query filter params (role.id=7f83d786d22243dab58a39a437993025, scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c, user.id=e9319052047e432b8fbd3348374b9003) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:48.182572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:48.184006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4412b-4625-4654-bd02-ef5006536b9f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:48.189992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 554/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:48 2022] GET /identity/v3/role_assignments?user.id=e9319052047e432b8fbd3348374b9003&scope.project.id=9b3bb0382fcd4eedbfeaf6cb277efb4c&role.id=7f83d786d22243dab58a39a437993025 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:50.247518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750820d-6510-42ef-84fb-e6643f09d266 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.248082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750820d-6510-42ef-84fb-e6643f09d266 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.248082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750820d-6510-42ef-84fb-e6643f09d266 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.249484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 577/1131] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:50.255078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.255497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.255621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.272432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:50.273659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:50.336971 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 555/1132] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:50.359907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750820d-6510-42ef-84fb-e6643f09d266 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.387566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.461137 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750820d-6510-42ef-84fb-e6643f09d266 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.494195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.494983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.495269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.495543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.496715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.498248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a900c-5b39-4f6c-be82-36891bb82968 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.499824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 578/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:50.506314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.547179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:50.602143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1efd48-6fb8-4960-b3b8-50ea27c0250a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.635580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.636230 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.636520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.636795 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.637533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.638944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278962ba-b15b-4f9e-9099-2c6f9fef3651 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.663912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 556/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:27:50 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:52.715145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64717-ef6c-47bc-b22f-1b301b6ae551 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.715664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64717-ef6c-47bc-b22f-1b301b6ae551 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.715664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64717-ef6c-47bc-b22f-1b301b6ae551 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.717102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 579/1135] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:52.722811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.723245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.723374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.740383 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:52.741529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:52.805975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 557/1136] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:52.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64717-ef6c-47bc-b22f-1b301b6ae551 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:52.922917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:52.929983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64717-ef6c-47bc-b22f-1b301b6ae551 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:52.964047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:52.964834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:52.965150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:52.965430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:52.966598 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:52.968126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20fc6a-430c-4f53-9bdb-960dff120438 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:52.970414 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 580/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:27:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:52.976289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:53.000041 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:53.072901 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd60b0-e5d7-4e60-9afc-26feb0f81dae None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:53.106209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:53.106867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:53.107155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:53.107434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:53.108153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:53.109602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4eafb-c18f-431d-a749-9de1caa4b3ea None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:53.128452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 558/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:27:52 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:27:55.182984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147ad-ae1e-424f-a5b8-0d18e60e1033 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.183511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147ad-ae1e-424f-a5b8-0d18e60e1033 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.183511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2147ad-ae1e-424f-a5b8-0d18e60e1033 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.184915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 581/1139] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:55.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.190604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.190784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.209537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:55.209735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:55.274705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 559/1140] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:27:55.299367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2147ad-ae1e-424f-a5b8-0d18e60e1033 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.402666 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2147ad-ae1e-424f-a5b8-0d18e60e1033 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.434980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.435701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.435992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.436273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.446611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:55.454867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:55.456077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:55.457264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:55.461021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 582/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:55.462126 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.473574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.558651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c756d7-d3a3-4e8e-9a06-0bbb41bee324 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.591573 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.592232 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.592635 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.592771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.593551 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:55.593855 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.595285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.603147 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 560/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:55.609417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.639708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.713135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea0ea-3e70-47d5-9130-820592ce0e8c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.745255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.746122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.746410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.746688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] PATH_INFO: `/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.759881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] RBAC: Authorizing `identity:get_user(user_id=3082e2899fc94cbfa6f07f872b6fd4cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.761348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:55.763004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 583/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:55.769377 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:55.837351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:55.866799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b32945-c30f-4303-99e2-3eac5aa12a47 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:55.899080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:55.899720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:55.900004 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:55.900280 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:55.964808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:55.966201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.031508 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.061276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 561/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:27:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:27:56.067722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.146616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:56.165144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d8e34-9d0a-4c68-a5a5-29c175361deb None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.198048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.198883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.199164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.199435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] PATH_INFO: `/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.200592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] RBAC: Authorizing `identity:get_project(project_id=c3bd0fe2a0ee45b2a4db6d777ffe9efd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.202036 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ee628-7c3c-448d-b205-2dedbd113095 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.203715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 584/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:56.209751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:56.306212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76a50b-dd38-4e22-bd53-c90d249c8cb8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:56.338251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:56.338892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:56.339173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:56.339449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:56.340282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=c3bd0fe2a0ee45b2a4db6d777ffe9efd, user.id=3082e2899fc94cbfa6f07f872b6fd4cd) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:56.340596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:56.342128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9a9da-0b4f-4981-9010-df8fd11f70e0 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:56.347955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 562/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:27:56 2022] GET /identity/v3/role_assignments?user.id=3082e2899fc94cbfa6f07f872b6fd4cd&scope.project.id=c3bd0fe2a0ee45b2a4db6d777ffe9efd&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:58.360494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4f90-4a90-407b-b783-b46b119ff878 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.361068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4f90-4a90-407b-b783-b46b119ff878 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.361068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4f90-4a90-407b-b783-b46b119ff878 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.362485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 585/1147] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:27:58.367655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.368053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.368208 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.385067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:58.386228 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:58.414544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.452624 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 563/1148] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:27:58.475594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d4f90-4a90-407b-b783-b46b119ff878 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.573015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d4f90-4a90-407b-b783-b46b119ff878 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.605122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.605892 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.606173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.606445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.617029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:27:58.624421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:27:58.625566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:27:58.626587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 586/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:27:58.631740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.727383 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d3e6b-de6a-41b7-a16b-7a6d18a719f6 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.760145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.760807 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.761124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.761399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.762151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:27:58.762459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.763832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.772224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 564/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:58.778304 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.791335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:58.875135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b185c0-e44c-4fbc-ade7-9cab4b6c84f1 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:58.907582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:58.908434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:58.908717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:58.909024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] PATH_INFO: `/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:58.910198 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] RBAC: Authorizing `identity:get_user(user_id=3082e2899fc94cbfa6f07f872b6fd4cd)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:58.911603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:58.913232 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 587/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:58.919027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:58.947530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:59.016205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6b6-5ba4-4b05-9874-f168ddc4114c None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:59.048716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:59.049588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:59.049873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:59.050154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] PATH_INFO: `/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:59.051336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] RBAC: Authorizing `identity:get_project(project_id=c3bd0fe2a0ee45b2a4db6d777ffe9efd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:59.052754 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3ab1-b59a-40c6-be28-bc4039771831 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:59.054475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 565/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:27:58 2022] GET /identity/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:27:59.060212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:59.135943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:59.157511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf64d6-a588-4ac0-a9a5-72739eaf386a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:59.189851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:59.190728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:59.191014 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:59.191312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] PATH_INFO: `/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd/users/3082e2899fc94cbfa6f07f872b6fd4cd/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:59.193295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] RBAC: Authorizing `identity:create_grant(project_id=c3bd0fe2a0ee45b2a4db6d777ffe9efd, user_id=3082e2899fc94cbfa6f07f872b6fd4cd, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:59.194750 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcbec-5376-45be-88e3-f119e509527a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:59.207434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 588/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:27:59 2022] PUT /identity/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd/users/3082e2899fc94cbfa6f07f872b6fd4cd/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:01.205803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47851a-ca16-4a0d-b868-4637406b51d2 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.206354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47851a-ca16-4a0d-b868-4637406b51d2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.206354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47851a-ca16-4a0d-b868-4637406b51d2 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.207716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 566/1154] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:01.213139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.213582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.213710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.230077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:01.231261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:01.296861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 589/1155] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:01.323703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47851a-ca16-4a0d-b868-4637406b51d2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.415822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.423471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47851a-ca16-4a0d-b868-4637406b51d2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.460841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.461581 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.461865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.462138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.472483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:01.479980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:01.481115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:28:01.482052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 567/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:01.487756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.551953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.584173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b7b95-518c-4750-bd9b-4bb088f8a8cf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.624445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.625168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.625458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.626487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:01.626794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.628140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.636139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 590/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:01.641831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.739279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f08549-b6a3-4d78-88b3-c8044db1488d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.772053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.772949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.773238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.773514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] PATH_INFO: `/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.774700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] RBAC: Authorizing `identity:get_user(user_id=3082e2899fc94cbfa6f07f872b6fd4cd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.776385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:01.778047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 568/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/users/3082e2899fc94cbfa6f07f872b6fd4cd => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:01.784327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:01.880071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff30f1f-0168-486f-ad7d-9182495e448e None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:01.908236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.914196 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:01.914843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:01.915132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:01.915412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:01.987349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:01.988797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.083943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 591/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:02.089727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:02.114828 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.187185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f0370-471c-44ef-8b5a-e204bd10b95f None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.220136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.221025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.221314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.221594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] PATH_INFO: `/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.222766 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] RBAC: Authorizing `identity:get_project(project_id=c3bd0fe2a0ee45b2a4db6d777ffe9efd)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.224204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96564dc4-a350-4167-8f0e-9179810ca269 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.225937 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 569/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:02 2022] GET /identity/v3/projects/c3bd0fe2a0ee45b2a4db6d777ffe9efd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:02.232062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:02.260742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:02.331437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858f5d5-b01b-49c7-b479-b60ba3c96c50 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:02.363574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:02.364152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:02.364435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:02.364710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:02.365578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=c3bd0fe2a0ee45b2a4db6d777ffe9efd, user.id=3082e2899fc94cbfa6f07f872b6fd4cd) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:02.365889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:02.367298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd4168-7726-4806-afe8-ef785b090226 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:02.373030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 592/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:02 2022] GET /identity/v3/role_assignments?user.id=3082e2899fc94cbfa6f07f872b6fd4cd&scope.project.id=c3bd0fe2a0ee45b2a4db6d777ffe9efd&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:04.411738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e017-f1f9-4d8e-abb7-91ea81e44318 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.412264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e017-f1f9-4d8e-abb7-91ea81e44318 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.412384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e017-f1f9-4d8e-abb7-91ea81e44318 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.413713 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 570/1162] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:04.418886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.419257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.419453 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.436688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:04.437908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:04.506738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 593/1163] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:04.529161 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e017-f1f9-4d8e-abb7-91ea81e44318 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:04.622452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:04.633679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e017-f1f9-4d8e-abb7-91ea81e44318 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:04.667315 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:04.667890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.668171 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.668446 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.732423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:04.733835 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:04.818940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:04.829021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 571/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:04.835173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:04.859259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:04.931660 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706f4d6-8f81-40e0-82c5-4007ba2a7372 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:04.964480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:04.965290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:04.965575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:04.965850 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:04.972914 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:04.974331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a72af4c1-cca9-4c14-b55a-861b58758212 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:04.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:04.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:28:04.995675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 594/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:28:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:04.996654 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:05.091662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794801-3585-4ccb-a58a-3ada9b779d26 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:05.124224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:05.124886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:05.125705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:05.125984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:05.126706 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:05.127016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:05.128369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eee77-c1b1-4fc2-b915-e59e20d9009f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:05.135333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 572/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Jul 11 14:28:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:07.136884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d99-4d00-464a-8603-b9fbbe2c01af None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:07.137444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d99-4d00-464a-8603-b9fbbe2c01af None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:07.137444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e321d99-4d00-464a-8603-b9fbbe2c01af None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:07.138819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 595/1167] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:07.144448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff376-3585-44a9-9179-b60e514ad5f4 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:07.144895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff376-3585-44a9-9179-b60e514ad5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:07.145044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff376-3585-44a9-9179-b60e514ad5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:07.162101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a97ff376-3585-44a9-9179-b60e514ad5f4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:07.163270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a97ff376-3585-44a9-9179-b60e514ad5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:07.211364 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:07.227787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 573/1168] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:07.250973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321d99-4d00-464a-8603-b9fbbe2c01af None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:07.337997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:07.354970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e321d99-4d00-464a-8603-b9fbbe2c01af None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:07.389789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:07.390365 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:07.390677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:07.390956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:07.391710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:07.393091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0ca4c-c259-4700-8ae3-58651da627ea None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:07.409280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 596/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Mon Jul 11 14:28:07 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:09.438661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed37-bb34-499f-9eae-c0203f46ae87 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.439186 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed37-bb34-499f-9eae-c0203f46ae87 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.439273 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed37-bb34-499f-9eae-c0203f46ae87 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.440587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 574/1170] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:09.445836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.446210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.446401 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.462723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:09.463893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:09.537233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 597/1171] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:09.561096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3ed37-bb34-499f-9eae-c0203f46ae87 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.660421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3ed37-bb34-499f-9eae-c0203f46ae87 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.693185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.693983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.694269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.694549 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] PATH_INFO: `/v3/domains/1334474d475947fc9358e44f2b6ad46f` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.704876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1334474d475947fc9358e44f2b6ad46f)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.706342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461806d1-834a-4136-95f6-83ab28f2d658 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.707955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 575/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Jul 11 14:28:09 2022] GET /identity/v3/domains/1334474d475947fc9358e44f2b6ad46f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:09.713865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:09.785335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:09.810425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21519c-55e2-4312-b223-1a5a9ad72b4d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:09.843026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:09.844211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:09.844495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:09.844769 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:09.845509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:09.846927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdacf54-1fa3-48de-ba4e-20838e9de7f7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:09.871257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 598/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:28:09 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:11.929191 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eae95-cd17-4805-bca0-5124c57f844a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.929741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eae95-cd17-4805-bca0-5124c57f844a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.929741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eae95-cd17-4805-bca0-5124c57f844a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.931045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 576/1174] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:11.936183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:11.936577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:11.936746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:11.954261 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:11.955446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:12.018999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 599/1175] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:12.043251 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eae95-cd17-4805-bca0-5124c57f844a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.090555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.143444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eae95-cd17-4805-bca0-5124c57f844a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.175606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.176455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.176738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.177037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] PATH_INFO: `/v3/domains/1334474d475947fc9358e44f2b6ad46f` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.178213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1334474d475947fc9358e44f2b6ad46f)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.179687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496400d6-20c9-43fe-8c63-93f36c12eec3 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.181267 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 577/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Jul 11 14:28:12 2022] GET /identity/v3/domains/1334474d475947fc9358e44f2b6ad46f => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:12.186967 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:12.240817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:12.283406 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f289ed-5132-49d2-81ba-56021ffe90b1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:12.317412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:12.318080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:12.318362 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:12.318636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:12.319419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:12.320888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd344f81-4737-475e-8825-fc8e7290b885 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:12.340971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 600/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:28:12 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:28:14.416494 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f757-bc96-403c-a8cc-af9785c9d397 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.417057 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f757-bc96-403c-a8cc-af9785c9d397 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.417170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f757-bc96-403c-a8cc-af9785c9d397 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.418459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 578/1178] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:14.423615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.423995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.424174 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.441082 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:14.442268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:14.507766 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 601/1179] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:14.532135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5f757-bc96-403c-a8cc-af9785c9d397 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:14.630261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5f757-bc96-403c-a8cc-af9785c9d397 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:14.644200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:14.664986 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:14.665769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.666054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.666330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.676139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:14.683648 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:14.684842 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:28:14.685780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 579/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:28:14.690923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:14.732643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:14.789094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595a574-9bdb-4b28-bb61-017cd385139e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:14.821491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:14.822150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.822437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.822715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.823465 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:14.823772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:14.825259 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:14.833710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 602/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:14.839598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:14.936309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696950c1-85f2-4445-ae65-40cd8dc41301 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:14.969263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:14.970138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:14.970425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:14.970705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] PATH_INFO: `/v3/users/ad5ad70c18d44556a23cf4659bf2fa14` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:14.983799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] RBAC: Authorizing `identity:get_user(user_id=ad5ad70c18d44556a23cf4659bf2fa14)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:14.985291 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:14.986952 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 580/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:14 2022] GET /identity/v3/users/ad5ad70c18d44556a23cf4659bf2fa14 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:14.992673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.092412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae48ba-151b-4a83-92dd-130b4cc442c7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.094709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.125403 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.126048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.126334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.126611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.192579 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.193977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.289957 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 603/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:15.295774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.327215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.394958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e68112-c056-44ea-a0d8-e8bc05751b6e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.428174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.429058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.429345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.429623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] PATH_INFO: `/v3/projects/5b1660beaf4a4622a6bd7fd97a806105` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] RBAC: Authorizing `identity:get_project(project_id=5b1660beaf4a4622a6bd7fd97a806105)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.435470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0e9e9-456e-40c2-bdc4-f11b2f29af0f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.437747 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 581/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/projects/5b1660beaf4a4622a6bd7fd97a806105 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:15.451732 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:15.454894 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:15.559287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a89d-fe34-490b-9957-829b9887e7a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:15.596273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:15.596943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:15.597228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:15.597503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:15.598336 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=5b1660beaf4a4622a6bd7fd97a806105, user.id=ad5ad70c18d44556a23cf4659bf2fa14) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:15.598648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:15.600060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2ccc-94c1-44ab-a4d6-0f32d661ccc9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:15.605509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 604/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:15 2022] GET /identity/v3/role_assignments?user.id=ad5ad70c18d44556a23cf4659bf2fa14&scope.project.id=5b1660beaf4a4622a6bd7fd97a806105&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:17.611306 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e86-7364-4c02-aecc-ac6201d664aa None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.611868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e86-7364-4c02-aecc-ac6201d664aa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.611868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e86-7364-4c02-aecc-ac6201d664aa None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.613242 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 582/1186] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:17.618375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.618808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.618935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.636094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:17.637312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:17.698026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.704005 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 605/1187] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:17.727386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327e86-7364-4c02-aecc-ac6201d664aa None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.822103 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:17.826634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327e86-7364-4c02-aecc-ac6201d664aa None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:17.859982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:17.860760 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:17.861077 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:17.861358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:17.871211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:17.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:17.880662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:28:17.881599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 583/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:17.886995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:17.980139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804734fe-1c87-42ee-bbdb-5d95fc0e81b5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.012456 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.013136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.013419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.013692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.014436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:18.014746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.016188 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.024265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 606/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:18.030281 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:18.128686 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31f494-5061-45ec-84f7-b916337018a9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.163279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.164141 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.164430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.164711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] PATH_INFO: `/v3/users/ad5ad70c18d44556a23cf4659bf2fa14` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.165918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] RBAC: Authorizing `identity:get_user(user_id=ad5ad70c18d44556a23cf4659bf2fa14)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.167339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.169129 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 584/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:18 2022] GET /identity/v3/users/ad5ad70c18d44556a23cf4659bf2fa14 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:18.175787 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:18.234997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:18.276477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f5b59-65cd-4da8-a18c-a29b112d6a00 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.308484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.309371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.309655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.309930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] PATH_INFO: `/v3/projects/5b1660beaf4a4622a6bd7fd97a806105` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.311095 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] RBAC: Authorizing `identity:get_project(project_id=5b1660beaf4a4622a6bd7fd97a806105)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.312512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4f8a-985f-4687-a5b6-49aa10820181 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.314236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 607/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:18 2022] GET /identity/v3/projects/5b1660beaf4a4622a6bd7fd97a806105 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:18.320146 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:18.348464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:18.416825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1e085-e349-4ba3-9ae0-f9ee576490fd None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:18.451797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:18.453227 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:18.453514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:18.453792 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] PATH_INFO: `/v3/projects/5b1660beaf4a4622a6bd7fd97a806105/users/ad5ad70c18d44556a23cf4659bf2fa14/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:18.455786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] RBAC: Authorizing `identity:create_grant(project_id=5b1660beaf4a4622a6bd7fd97a806105, user_id=ad5ad70c18d44556a23cf4659bf2fa14, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:18.457247 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd32ce-950f-473d-9214-b95198a0226f None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:18.470473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 585/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:28:18 2022] PUT /identity/v3/projects/5b1660beaf4a4622a6bd7fd97a806105/users/ad5ad70c18d44556a23cf4659bf2fa14/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:20.517792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22cd88-0bfe-4291-8f5c-2a387be90064 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.518326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22cd88-0bfe-4291-8f5c-2a387be90064 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.518326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22cd88-0bfe-4291-8f5c-2a387be90064 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.519700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 608/1193] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:28:20.524941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.525361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.525773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.542963 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:28:20.544190 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:28:20.615457 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 586/1194] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:28:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:28:20.639342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22cd88-0bfe-4291-8f5c-2a387be90064 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.738066 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22cd88-0bfe-4291-8f5c-2a387be90064 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.763272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.771686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.772465 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.772748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.773051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.783498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:28:20.791061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:28:20.792142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:28:20.793423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 609/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:28:20.798271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:20.816209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:20.895949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea898c-50b7-4edb-ac65-83405425dd9f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:20.930245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:20.930896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:20.931174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:20.931452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:20.932202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:20.932518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:20.933903 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:20.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 587/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:20.948211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.045731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b43ed-53a4-4414-a15e-4d06dd074137 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.080640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.081661 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.082226 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.082226 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] PATH_INFO: `/v3/users/ad5ad70c18d44556a23cf4659bf2fa14` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.083561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] RBAC: Authorizing `identity:get_user(user_id=ad5ad70c18d44556a23cf4659bf2fa14)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.085068 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.086733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 610/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Jul 11 14:28:20 2022] GET /identity/v3/users/ad5ad70c18d44556a23cf4659bf2fa14 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:21.096928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.181894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.201772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c861b-2e52-40e8-88ef-8a2c474ef284 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.235128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.235777 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.236064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.236339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.309547 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.310637 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.389142 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.408929 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 588/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:28:21.417065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.476205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:21.520485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1400b74-f1fd-48ba-8131-13d980c10f20 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.553052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.553895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.554176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.554449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] PATH_INFO: `/v3/projects/5b1660beaf4a4622a6bd7fd97a806105` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.555607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] RBAC: Authorizing `identity:get_project(project_id=5b1660beaf4a4622a6bd7fd97a806105)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.557040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e6328-91eb-4efe-98ee-69aaea7d0074 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.558756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 611/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/projects/5b1660beaf4a4622a6bd7fd97a806105 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:21.565906 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:28:21.677000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec9d72-d849-45c1-be42-587804dcce26 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:28:21.711331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:28:21.711978 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:28:21.712260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:28:21.712532 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:28:21.713393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=5b1660beaf4a4622a6bd7fd97a806105, user.id=ad5ad70c18d44556a23cf4659bf2fa14) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:28:21.713705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:28:21.715111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e56ee-438e-4af8-90c6-5a696baa7b97 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:28:21.721843 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 589/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:28:21 2022] GET /identity/v3/role_assignments?user.id=ad5ad70c18d44556a23cf4659bf2fa14&scope.project.id=5b1660beaf4a4622a6bd7fd97a806105&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:28:31.549022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=38 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:31.718321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=78 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:17.436483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cb92-e0a2-4a37-8cb6-f15eb43890e4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.437132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cb92-e0a2-4a37-8cb6-f15eb43890e4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.437132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cb92-e0a2-4a37-8cb6-f15eb43890e4 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.438884 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 612/1201] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:17.446808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.446808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.446808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.465781 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:17.466820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:17.563547 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 590/1202] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:29:17.589688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cb92-e0a2-4a37-8cb6-f15eb43890e4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.705897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cb92-e0a2-4a37-8cb6-f15eb43890e4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:17.743848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:17.744075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.744327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.744563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.756951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:17.758417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:17.783756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:17.785002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:17.786012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:17.786012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:17.786012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:17.786012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:17.786012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 613/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:17.794871 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:17.921399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb6b82-72d5-4770-91ab-7f1cdbf32a2d None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:17.958984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:17.970692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:17.971703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:17.971703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:17.971866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:17.972670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:17.973507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:17.975027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea94971-bdd5-4499-babf-fbad9a73eff7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:17.990393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 591/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:17.996815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:18.069999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:18.144224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1791f-ce22-4685-92f9-27be2335dc62 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:18.200514 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:18.201429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:18.201754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:18.202040 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:18.202980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:18.204690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125068f5-77dd-4489-a0cb-137757a6dbda None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:18.240899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 614/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Jul 11 14:29:17 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:20.466699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f900-fba2-42bc-ac19-237249a263f2 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.467243 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f900-fba2-42bc-ac19-237249a263f2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.467342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33f900-fba2-42bc-ac19-237249a263f2 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.468826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 592/1206] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:20.474416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.474863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.474963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.495467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:20.496796 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:20.587227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 615/1207] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:20.611861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33f900-fba2-42bc-ac19-237249a263f2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.732016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33f900-fba2-42bc-ac19-237249a263f2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.778085 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.778916 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.779178 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.779451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.790038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:20.798254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:20.799240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:20.800122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 593/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:20.807243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:20.856879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:20.928015 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00892b9c-26a6-4962-9f86-703b7a70bd86 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:20.970307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:20.971224 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:20.971518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:20.971837 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:20.972627 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:20.973008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:20.974563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:20.983865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 616/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:20.989212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.047326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.108669 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2a368-202b-47cb-ab80-7a288b2dc810 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.151624 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.152513 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.153003 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.153353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.166451 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.168019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:21.194250 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:21.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:21.196170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:21.196170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:21.196170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:21.196170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:21.196170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 594/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:21.201961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.315943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.319602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b767bc-c182-4e61-bec9-9d461b4dccb9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.361913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.362619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.362987 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.363271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.364048 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:21.364441 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.365946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.379059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 617/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:21.385290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.505804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a943ec8-e142-448a-aad0-fab2b53a7a70 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.507527 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:21.548530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.549459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.549751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.550036 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.558416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.559913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:21.577060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:21.578474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:21.579441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 595/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:21.584079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.703294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7a8b-75de-4a61-8bb9-9f1cfff57107 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.745677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.746404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.746698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.746979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.748016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:21.748339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:21.749931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:21.772965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 618/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:21.779498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:21.901054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc76b4d-0e04-4359-a89b-b6e67d229286 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:21.950344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:21.951038 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:21.951413 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:21.951602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:21.986461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.034772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.036312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.174787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 596/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:22.180517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.207054 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.299284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908f364-6100-4b74-8513-1dd492bb0067 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.341586 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.342415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.342705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.342982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.355060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.356805 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:22.376603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:22.377760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:22.378838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:22.378838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:22.378838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:22.378838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:22.380430 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 619/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:22.386388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.464440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.508397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1c5db-d33f-4ba4-8878-01ec8717677a None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.555702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.555702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.555702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.555702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.556193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:22.556193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.556193 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.568077 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 597/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:22.573761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.650182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.688804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d996-69f6-4704-b49e-df4001d9f2ce None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.729472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.730904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.731288 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.731602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.738518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.740025 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:22.754539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:22.762138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:22.763247 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 620/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:22.765372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:22.892832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98b2d-4a23-4865-931d-04b19cf73661 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:22.923035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:22.937300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:22.938102 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:22.938507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:22.938907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:22.939838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:22.940326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:22.942058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf16a38-7681-47c8-ae2e-e890fdf840de None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:22.956532 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 598/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:22.962413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:23.079513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aba17-247f-463d-81cf-41b470bee26c None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:23.112067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:23.119711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:23.120404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:23.121592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:23.121731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:23.122666 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=de41fb2b889b4847bfecbe6ea7585803) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:23.123021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:23.124488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c47ee9-b9b2-4f8b-b1fe-72a343e5e758 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:23.141073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 621/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:22 2022] GET /identity/v3/role_assignments?user.id=de41fb2b889b4847bfecbe6ea7585803&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:25.251645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8653bb-68ef-4717-afb4-979305154f58 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.252372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8653bb-68ef-4717-afb4-979305154f58 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.252372 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8653bb-68ef-4717-afb4-979305154f58 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.253629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 599/1220] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:29:25.259822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.260297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.260408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.279993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:25.281385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:25.360017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 622/1221] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:25.385311 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8653bb-68ef-4717-afb4-979305154f58 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.509816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8653bb-68ef-4717-afb4-979305154f58 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.546118 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.546921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.547219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.547500 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.558705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:25.569289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:25.570470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:25.571309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 600/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:25.577208 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.683312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cf46c-0e93-4024-9a70-d53d43902eb9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.711921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:25.729136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.729985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.731071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.731458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.732358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:25.732740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:25.734328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:25.748888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 623/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:25.750993 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:25.799608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:25.863443 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ffe69-2c24-40a7-9e4c-03f2594003f7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:25.898388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:25.899438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:25.899725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:25.900005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:25.910796 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:25.912235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:25.931326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:25.932405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:25.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:25.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:25.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:25.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:25.933940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 601/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:25.939131 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.050937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579f22-882f-40c6-b538-63a882cdc7b9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.089045 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.089745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.090033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.090314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.091046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:26.091359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.092726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.104549 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 624/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:26.111681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.215499 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.226033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c551d-9884-42fa-91ea-4a99bf0545c5 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.262035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.262941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.263267 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.263617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.272475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.274359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:26.291546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:26.292740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:26.294535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:26.298838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 602/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:26.299896 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.348219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.404391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ba849-c957-4440-98df-92fcb844ebf6 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.442721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.443394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.443678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.443953 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.444802 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:26.445133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.446568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.466130 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 625/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:26.471703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.590434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87f2b3-46e0-4098-8770-1acbc41af715 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.636114 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.637383 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.637667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.637955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.651132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.653331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:26.673155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:26.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:26.675177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:26.675177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:26.675177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:26.675177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:26.675177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 603/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:26.680379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.810385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcfcc4-6f94-443f-8578-a42a1b4c6949 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:26.814150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:26.854439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:26.855310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:26.855310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:26.855495 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:26.856207 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:26.856517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:26.857979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:26.873499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 626/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:26.880215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:26.892347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:27.016708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fed5-5253-44f5-9623-7c59b630b0ba None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:27.059022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:27.059857 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.060121 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.060400 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.067727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:27.069222 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:27.084106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:27.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:27.086303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 604/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:27.092764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:27.210631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442de7d-71a5-4caa-9bbb-0dc325425017 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:27.250640 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:27.251317 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.251606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.251888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.252702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:27.253053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:27.254523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c0d9-e1bb-44bf-af00-af29f6dca169 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:27.270716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 627/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:27.278788 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:27.365000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:27.413297 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a9c70-90e2-4b8d-a681-773c723176c9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:27.454152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:27.458270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:27.458270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:27.458270 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/de41fb2b889b4847bfecbe6ea7585803/roles/cde6092919de481682a6f26edfaa9de2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:27.479198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=de41fb2b889b4847bfecbe6ea7585803, role_id=cde6092919de481682a6f26edfaa9de2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:27.481609 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9587ce-0f5e-422d-aa6b-bc45eacc92f5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:27.497369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 605/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:27 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/de41fb2b889b4847bfecbe6ea7585803/roles/cde6092919de481682a6f26edfaa9de2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:29.718267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73b1e-4826-4b2f-827a-2629cd93e16a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.718878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73b1e-4826-4b2f-827a-2629cd93e16a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.718878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73b1e-4826-4b2f-827a-2629cd93e16a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.720454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 628/1233] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:29.725867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.726320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.726496 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.745532 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:29.746718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:29.817220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 606/1234] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:29.841725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73b1e-4826-4b2f-827a-2629cd93e16a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:29.868283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:29.946683 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73b1e-4826-4b2f-827a-2629cd93e16a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:29.986609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:29.987405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:29.987691 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:29.987986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:29.999513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:30.007150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:30.008283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:30.009531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 629/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Jul 11 14:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:30.014420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.064379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:30.122349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46be978-0ec3-44af-bcee-4fcb39c393c7 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.164729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.165583 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.165752 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.166027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.166782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] RBAC: Adding query filter params (name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:30.167091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.169054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.177552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 607/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:30.183739 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.294322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:30.312634 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90444a30-1635-49e0-aa82-7de93e814652 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.349755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.350584 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.350874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.352114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.363641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.365138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:30.383341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:30.384713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:30.385751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:30.385751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:30.385751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:30.385751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:30.385751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 630/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:30.391149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.504656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea19e-c994-4705-8392-fe9cc6e9a874 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.515032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:30.546680 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.547370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.547658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.547932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.548670 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:30.549006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.550383 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.563414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 608/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:29:30.569754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.681879 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab1be-0091-4d87-95c4-faf46e51bcc0 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.718970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.719836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.720119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.720389 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.723280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:30.732326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.733862 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:30.749379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:30.750563 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:30.751551 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 631/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:30.757024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:30.871301 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7c72f-aff5-4d00-903d-463c5a660894 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:30.909410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:30.910085 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:30.910375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:30.910647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:30.911497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:30.911811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:30.913284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:30.930503 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 609/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:30.936963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.046074 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170c7de-1115-43be-a79f-993d5e380dfc None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.083600 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.084395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.084715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.085081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.154059 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.161134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.162583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.280386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 632/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:31.286425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.315370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.392982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f38693-9056-4588-ac11-2c8fbd88a1a9 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.429742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.430471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.430758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.431034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.441800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.443248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:31.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:31.462375 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:31.463319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:31.463319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:31.463319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:31.463319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:31.463319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 610/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:31.468946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.572803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.580092 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec728d4-48c5-4902-a62e-2177bee65602 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.618939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.619713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.620000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.620291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.621285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:31.621616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.623492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.635610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 633/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:31.641831 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.727181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:31.752658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e91aab-1cda-4ff8-91b0-0b5953169fc7 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.793800 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.794640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.795047 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.795388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.802849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.804501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:31.821454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:31.822615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:31.824144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 611/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:31.829492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:31.945102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a9e1-0210-46ef-979a-9fe3dfd30c05 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:31.983948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:31.984548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:31.984832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:31.985141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:31.985941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:31.986265 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:31.987688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2c12-2e32-4f73-97c8-fe4caec0b83a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.000018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 634/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:32.006116 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:32.114346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3fa2f-a0e5-40bb-a678-be8d1805b403 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:32.154087 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:32.154748 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:32.155034 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:32.155312 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:32.156158 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] RBAC: Adding query filter params (role.id=cde6092919de481682a6f26edfaa9de2, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=de41fb2b889b4847bfecbe6ea7585803) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:32.156481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:32.157939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465b78-cde0-4190-b936-f00d0bf77a6b None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:32.164825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 612/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:32 2022] GET /identity/v3/role_assignments?user.id=de41fb2b889b4847bfecbe6ea7585803&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=cde6092919de481682a6f26edfaa9de2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:34.334006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2dbc6-0ee8-4fac-8d26-99663061518e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:34.334592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2dbc6-0ee8-4fac-8d26-99663061518e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:34.334592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2dbc6-0ee8-4fac-8d26-99663061518e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:34.335955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 635/1247] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:34.341344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:34.341893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:34.341893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:34.347598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:34.361672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:34.363023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:34.441945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 613/1248] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:34.470602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2dbc6-0ee8-4fac-8d26-99663061518e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:34.491659 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:34.591023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2dbc6-0ee8-4fac-8d26-99663061518e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:34.630514 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:34.631363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:34.631618 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:34.631897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:34.643643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:34.653316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:34.655078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:34.657103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 636/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:34.662327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:34.793166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d28836-fd4f-48a5-a010-28098be1d7e6 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:34.832024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:34.840294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:34.841146 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:34.841432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:34.841659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:34.842939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:34.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:34.845094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:34.855328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 614/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:34.861479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:34.950291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:34.977484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02241df-cf24-4282-b3f5-a496ec9a39ba None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:35.016567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:35.017630 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.017986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.018328 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.032531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:35.034140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:35.053994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:35.055046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:35.060946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:35.060946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:35.060946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:35.060946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:35.060946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 637/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:35.062037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:35.175519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf271b1-e9c8-441a-be31-5ee963e44bac None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:35.217290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:35.218066 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.218493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.218913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.219745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:35.220331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:35.222120 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:35.240370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 615/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:35.246075 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:35.359078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59ac2-5be5-419f-b863-853b87544f30 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:35.388841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:35.397945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:35.399279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.399597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.399986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.412336 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:35.414139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:35.433088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:35.434385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:35.435920 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 638/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:29:35.440502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:35.508596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:35.561068 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7573-db53-416c-b555-6964b8aa5d20 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:35.598260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:35.599079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.599462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.599817 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.600750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:35.601145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:35.602634 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:35.621804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 616/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:35.627754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:35.757470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a5de-42fb-4a03-b969-c245a06236a8 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:35.806160 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:35.807000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:35.807330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:35.807605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:35.883701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:35.898212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:35.900113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.012812 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 639/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:36.019418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.134079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3b8c3-e6eb-4f41-a25c-7876ac0fab43 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.148418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.173096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.173893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.174185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.174465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.184927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.186394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:36.208750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:36.209786 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:36.210697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:36.210697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:36.210697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:36.210697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:36.210697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 617/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:36.216722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.319972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.333497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff4ff-405c-4adf-b6a1-171ce51d7230 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.369061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.369752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.370087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.370311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.370979 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:36.371288 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.372648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.384475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 640/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:36.390741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.502481 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499295d-55b1-4706-952d-dbd3a6d56edb None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.542662 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.543476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.543753 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.544023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.551922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.553762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:36.569370 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:36.570700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:36.571839 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:36.573779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 618/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:36.579851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.689245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf0b4-1f6b-4d95-a6b4-04352dd50c6a None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.728982 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.730498 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.730782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.731058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.731970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:36.732280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.734167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca531ff-658c-4fd7-91e7-6cdbcc0ab65b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.747193 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 641/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:36.753258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:36.785199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:36.870213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447760-a283-4792-ad75-ea1ccf5c828e None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:36.906603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744368c-6455-4253-800e-73a63495c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:36.907299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744368c-6455-4253-800e-73a63495c171 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:36.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744368c-6455-4253-800e-73a63495c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:36.907864 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744368c-6455-4253-800e-73a63495c171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:36.908709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744368c-6455-4253-800e-73a63495c171 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=de41fb2b889b4847bfecbe6ea7585803) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:36.909049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744368c-6455-4253-800e-73a63495c171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:36.910489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744368c-6455-4253-800e-73a63495c171 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:36.915999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 619/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:36 2022] GET /identity/v3/role_assignments?user.id=de41fb2b889b4847bfecbe6ea7585803&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:38.946010 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e18c-32b7-482d-853a-f0711c6a155d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.946521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e18c-32b7-482d-853a-f0711c6a155d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.946521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e18c-32b7-482d-853a-f0711c6a155d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.947859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 642/1261] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:38.953160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:38.953572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:38.953723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:38.970823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:38.972020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:39.035958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 620/1262] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:39.058840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e18c-32b7-482d-853a-f0711c6a155d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.069460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.160242 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e18c-32b7-482d-853a-f0711c6a155d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.194831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.195687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.195967 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.196400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.208297 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:39.217923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:39.219078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:39.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 643/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:39.225858 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.246907 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.326182 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddd561-5ccc-48d2-8904-5713dee1935a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.358933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.359597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.359886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.360165 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.360949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:39.361263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.362636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.370470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 621/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.376222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.440763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.474186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adde70-f82b-4ca1-a1a4-72e985d5c464 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.506363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.507147 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.507433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.507717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.518557 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.519985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:39.537329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:39.538391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:39.539509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:39.539509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:39.539509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:39.539509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:39.539509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 644/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:39.544409 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.622402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.641462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc51c-bf0e-47dd-b664-39c556883ab1 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.673349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.674000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.674287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.674567 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.675296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:39.675609 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.677011 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.689444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 622/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:39.695102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.790581 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dca32b-475a-4cb5-b48d-53ed305ac1aa None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.809993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:39.824917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.825723 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.826011 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.826290 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.833819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.835243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:39.849841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:39.850925 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:39.852079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 645/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:39.857514 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:39.957823 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789c08-e7ed-43c9-bf0d-66effea47743 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:39.991440 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:39.992105 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:39.992386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:39.992658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:39.993534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:39.993846 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:39.995293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.003775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.013026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 623/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.018568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.114610 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa96d43-dcad-44a2-8f17-1b2296ee4033 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.146778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.147558 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.147847 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.148126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.159114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.160538 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:40.177158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:40.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:40.178902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:40.178902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:40.178902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:40.178902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:40.178902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 646/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:40.184012 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.296109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d95-c2ea-441f-8e5b-e293377b6b75 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.337351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.338010 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.338300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.338579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.339894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.340198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.341598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.352813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 624/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.358524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.390245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.457032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d6b1-31ab-46db-a8a4-e75947a9e312 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.490653 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.491443 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.491728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.492003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.499475 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.500973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:40.515719 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:40.516753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:40.517703 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 647/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:40.522700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.580534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.621506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e523b-fb73-48e3-9610-1e99ded3e982 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.654646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.655235 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.655525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.655805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.656606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:40.656954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.658371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700418da-8aad-4707-9468-27c577cb94ff None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.670806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 625/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:40.676677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:40.764062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:40.772963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd876f60-e100-4596-8dd2-18d284b78aa7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:40.806544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:40.807426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:40.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:40.808513 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] PATH_INFO: `/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/de41fb2b889b4847bfecbe6ea7585803/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:40.810520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e710ed947f4faaaafaf8b34d1028b6, user_id=de41fb2b889b4847bfecbe6ea7585803, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:40.811923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65fcad-7bb3-4a95-a47e-76e4e912a464 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:40.824913 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 648/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Jul 11 14:29:40 2022] PUT /identity/v3/projects/77e710ed947f4faaaafaf8b34d1028b6/users/de41fb2b889b4847bfecbe6ea7585803/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:29:42.857619 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f2d2-af11-4eff-b9f6-eac539a36462 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.858188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f2d2-af11-4eff-b9f6-eac539a36462 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.858188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6f2d2-af11-4eff-b9f6-eac539a36462 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.859471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 626/1274] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:42.864446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:42.864838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:42.865037 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:42.881307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:42.882484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:42.946554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 649/1275] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:42.970319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6f2d2-af11-4eff-b9f6-eac539a36462 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.070416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6f2d2-af11-4eff-b9f6-eac539a36462 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.086829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.102806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.103579 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.103862 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.104635 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.114520 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:29:43.122663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:43.123850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:43.124776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 627/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Jul 11 14:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:43.130102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.207842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.225922 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94137c59-09af-49d3-92a4-9ad15439d9e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.259050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.259712 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.259997 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.260275 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.261073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:43.261380 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.262742 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.270511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 650/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.276580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.374733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd39-2379-45cc-b405-7ce82c2bd177 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.407620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.408401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.408685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.408990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.419292 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.420729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:43.437656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:43.438698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:43.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:43.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:43.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:43.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:43.439868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 628/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:43.444655 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.542845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cd840-473c-474b-bcf5-4b8fc10e5ac7 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.574487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.575142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.575429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.575709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.576435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:43.576743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.578140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.590081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 651/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.595698 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.625485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.691886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b6854-6275-45ac-978e-4beb39c8cb84 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.724260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.725072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.725357 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.725632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.733007 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.734447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:29:43.748629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:43.749676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:43.750733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 629/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:43.755491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.759237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:43.851266 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e425b-2208-4d74-882b-5edeb9e53756 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:43.883481 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:43.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:43.884358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:43.884632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:43.886022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:43.886329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:43.887729 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:43.905772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 652/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:43.911473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:43.997359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.006880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83478d2-c148-4b89-894f-0b150dcd27b8 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.040474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.041139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.041422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.041720 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.115528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.117793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.221765 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.232588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 630/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Jul 11 14:29:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:29:44.238385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.296946 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.333246 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7499-a5c5-452d-8a09-f12efd562801 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.367936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.368726 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.369038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.369313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.380176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.381931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:29:44.399923 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:44.401488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:44.402379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:29:44.402379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:29:44.402379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:29:44.402379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:44.402379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 653/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:44.407393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.502162 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a68864-4e41-491a-a4e0-3bb0d4d669e2 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.535972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.536620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.536924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.537198 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.537918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:44.538219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.539571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.550407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 631/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:44.556023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.653306 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0759c-fae5-45d6-b6bc-a6bd67016c7b None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.666728 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.686788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.687567 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.687852 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.688127 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.696033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:29:44.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:44.711021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: ERROR keystone.server.flask.application Jul 11 14:29:44.712486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 654/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:44.717556 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.766298 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:44.814762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5ebdc-b47b-4a83-bc08-2f32297c7636 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.846331 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.846984 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.847272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.847549 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.848345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:44.848657 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:44.850103 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67a2f-8f55-4509-8b02-97651c274bc5 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:44.862223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 632/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:44.868161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:44.965632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee1aa-8b69-4abe-9849-3c4fa68c9d13 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:44.997954 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:44.998593 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:44.998883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:44.999164 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:44.999996 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] RBAC: Adding query filter params (role.id=b513ad68ac0842deaa147cad48f0dd76, scope.project.id=77e710ed947f4faaaafaf8b34d1028b6, user.id=de41fb2b889b4847bfecbe6ea7585803) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:45.000314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:45.001764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abbb9a-286a-4a96-a7ff-f07cc727bd38 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:45.007446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 655/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Jul 11 14:29:44 2022] GET /identity/v3/role_assignments?user.id=de41fb2b889b4847bfecbe6ea7585803&scope.project.id=77e710ed947f4faaaafaf8b34d1028b6&role.id=b513ad68ac0842deaa147cad48f0dd76 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.028787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe6e2-89e3-4a31-bfd4-18df9b4c4306 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.029329 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe6e2-89e3-4a31-bfd4-18df9b4c4306 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.029449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe6e2-89e3-4a31-bfd4-18df9b4c4306 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.030727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 633/1288] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:47.035865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.036250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.036434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.052941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:47.054139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:47.083139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.120336 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 656/1289] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:47.142747 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abe6e2-89e3-4a31-bfd4-18df9b4c4306 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.249469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abe6e2-89e3-4a31-bfd4-18df9b4c4306 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.262094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:47.285339 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.286067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.286349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.286623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.287275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.288622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:47.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:47.301867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:47.303076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 634/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:47.308310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.404236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586c1f-ed11-4579-b888-15b821a8a8d8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.437382 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.438043 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.438335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.438616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.439329 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:47.439641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.441023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9b2df-0e94-4319-8629-e9fe5b755a33 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.445753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 657/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:47.452084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:47.550518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05296ed-8e9a-4dc2-9bd7-8774c677e525 None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:47.582745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:47.583395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:47.583685 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:47.583966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] PATH_INFO: `/v3/services` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:47.584678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:47.585019 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:47.586389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fac073-d14e-4498-884f-98b6a0a9a80d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:47.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 635/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Jul 11 14:29:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:49.590644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce926-de19-4ec8-b995-06b8e9d77ed2 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.591184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce926-de19-4ec8-b995-06b8e9d77ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.591184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ce926-de19-4ec8-b995-06b8e9d77ed2 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.592580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 658/1293] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:49.597587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cf0b-1b37-4379-8d8b-d5387a2565c0 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.597999 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cf0b-1b37-4379-8d8b-d5387a2565c0 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.598153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cf0b-1b37-4379-8d8b-d5387a2565c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.615244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-dd51cf0b-1b37-4379-8d8b-d5387a2565c0 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:49.616416 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-dd51cf0b-1b37-4379-8d8b-d5387a2565c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:49.644215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.681355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 636/1294] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:49.703839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce926-de19-4ec8-b995-06b8e9d77ed2 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:49.735062 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:49.804281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ce926-de19-4ec8-b995-06b8e9d77ed2 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:49.836445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:49.837121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:49.837409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:49.837687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:49.838975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:49.840327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba20b-8b6c-40a2-97fc-d91a094370a8 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:49.855833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 659/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Jul 11 14:29:49 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:29:51.881816 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77632462-3fbe-41a5-9a14-5ff9307b2976 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.882332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77632462-3fbe-41a5-9a14-5ff9307b2976 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.882332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77632462-3fbe-41a5-9a14-5ff9307b2976 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.883673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 637/1296] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:51.888863 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:51.889273 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:51.889429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:51.906439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:51.907601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:51.978169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 660/1297] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:52.000916 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77632462-3fbe-41a5-9a14-5ff9307b2976 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.098205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77632462-3fbe-41a5-9a14-5ff9307b2976 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.129636 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.130418 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.130697 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.130966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.131613 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.133050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:52.145046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:52.146200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:52.147072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 638/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:29:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:52.152978 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.170643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.257300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3f93-d9ea-4561-8059-206202e628d4 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.291370 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.292029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.292312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.292588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.293327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:52.293636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.294990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.300053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 661/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:52.306099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.337813 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.409639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea071a8-0df6-461b-becf-48f10dd5db1d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.444943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.445596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.445880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.446157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.446951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] RBAC: Adding query filter params (interface=public, service_id=8832712260014bc18efdf9cf9a703ec1, region_id=RegionOne) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:52.447263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.449221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f017448-e9f4-4deb-999c-4359bdcc2f6a None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.454188 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 639/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/endpoints?service_id=8832712260014bc18efdf9cf9a703ec1&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:52.459773 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:52.539201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:52.556592 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4797a-4d39-46f5-baa0-2a2856c6eee9 None admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:52.591177 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:52.591836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:52.592122 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:52.592399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:52.593112 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:52.595161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec1d41-5dd0-4e18-925e-a23d5aa3aa64 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:52.603568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 662/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Jul 11 14:29:52 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:29:54.624734 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa274-088e-47fa-a0fb-ca88d9c195e7 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:54.625336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa274-088e-47fa-a0fb-ca88d9c195e7 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:54.625336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa274-088e-47fa-a0fb-ca88d9c195e7 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:54.626694 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 640/1302] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:29:54.631806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:54.632213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:54.632376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:54.649637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:29:54.650856 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:29:54.715134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 663/1303] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:29:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:29:54.737606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa274-088e-47fa-a0fb-ca88d9c195e7 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:54.830950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:54.837672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa274-088e-47fa-a0fb-ca88d9c195e7 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:54.870802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:54.871590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:54.871874 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:54.872151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:54.872799 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:54.874261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:29:54.886687 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:29:54.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application with Lock( Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: ERROR keystone.server.flask.application Jul 11 14:29:54.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 641/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Jul 11 14:29:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:29:54.893764 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:54.967117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:29:54.990284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c830-ed4c-48d0-9148-148ede8664de None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:55.024492 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:55.025324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:55.025638 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:55.025916 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] PATH_INFO: `/v3/services` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:55.026635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:29:55.026942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:55.028305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4152d-4f3b-4cfa-ac48-6cfe0751e096 None admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:55.033919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 664/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Jul 11 14:29:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:29:55.039904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:29:55.141465 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273449d-9c12-42cf-aad7-377b024eb89d None admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:29:55.177046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:29:55.177700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:29:55.177988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:29:55.178262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:29:55.179014 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:29:55.180374 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7e1a-f973-440b-b16c-785523c05f97 None admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:29:55.200021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 642/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Jul 11 14:29:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:30:05.030611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=30 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:05.195851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:30:59.963189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f77f-16b7-470a-8b86-2abf022f3f97 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f77f-16b7-470a-8b86-2abf022f3f97 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f77f-16b7-470a-8b86-2abf022f3f97 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:30:59.968754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 665/1307] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:30:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:30:59.970244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aac4-bb83-4fd0-8f83-a6f8f9f26e0c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:30:59.970684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aac4-bb83-4fd0-8f83-a6f8f9f26e0c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:30:59.970914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668aac4-bb83-4fd0-8f83-a6f8f9f26e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.120646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c668aac4-bb83-4fd0-8f83-a6f8f9f26e0c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:00.122283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c668aac4-bb83-4fd0-8f83-a6f8f9f26e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:00.289348 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 643/1308] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:00.336793 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.337202 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.337558 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.339010 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 666/1309] 10.222.0.73 () {54 vars in 964 bytes} [Mon Jul 11 14:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:00.345245 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407f54-7b9f-4e15-80cb-5d9167d57b2f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.345621 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407f54-7b9f-4e15-80cb-5d9167d57b2f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.345968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3407f54-7b9f-4e15-80cb-5d9167d57b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.441131 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b3407f54-7b9f-4e15-80cb-5d9167d57b2f None None] MFA Rules not processed for user `36fa4087f9e348ea87a4d918a23b5660`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:00.442441 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b3407f54-7b9f-4e15-80cb-5d9167d57b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:00.464957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.526784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 644/1310] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Jul 11 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:00.535841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:00.537739 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:00.661843 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845c16-ee94-44b4-81dd-80e3a69e67ab None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:00.738510 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:00.739190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:00.739477 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:00.739756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:00.741601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:00.805462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:00.867738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:00.869228 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295ae08-fd44-4669-8a21-2edf1ef67e23 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:00.890901 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 667/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:03.218958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.219526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.221933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 645/1312] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:03.226714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166371d0-2ff8-4e98-86fa-38035b9d00b4 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.227233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166371d0-2ff8-4e98-86fa-38035b9d00b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.227325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166371d0-2ff8-4e98-86fa-38035b9d00b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.319718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-166371d0-2ff8-4e98-86fa-38035b9d00b4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:03.320935 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-166371d0-2ff8-4e98-86fa-38035b9d00b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:03.423097 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 668/1313] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:03.461733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:03.463248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:03.576386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed028a5-eba5-4d9a-b2e5-a9443d70fc15 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:03.656317 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:03.660961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:03.662395 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:03.663013 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:03.663756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:03.667219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:03.801076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:03.802421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a525-8f7a-4bb1-b8db-0b0c504cb63c service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:03.821115 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 646/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:31:06.176602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.177213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.177213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.178552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 669/1315] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:06.184269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3c05-fd5b-4f4f-847f-7dfc4995358c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.184673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3c05-fd5b-4f4f-847f-7dfc4995358c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.184827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f3c05-fd5b-4f4f-847f-7dfc4995358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.249104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a65f3c05-fd5b-4f4f-847f-7dfc4995358c None None] MFA Rules not processed for user `fe78eae3bd8c4ef2bc2b7bc1e0dfa808`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:06.250314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a65f3c05-fd5b-4f4f-847f-7dfc4995358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:06.301367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.346508 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 647/1316] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:06.385153 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:06.386673 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:06.396561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.489006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8834c1-de37-42c7-9267-415e33058d5e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:06.560402 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:06.561071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:06.561357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:06.561635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:06.563281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:06.624316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:06.670899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:06.672311 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951d9d-cfcb-4f26-9320-f22ddcf04671 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:06.689730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 670/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:09.285733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.286263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.286263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.287653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 648/1318] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:31:09.293569 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7b50-7a81-4faa-92ee-2f9d9dffa50d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.293966 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7b50-7a81-4faa-92ee-2f9d9dffa50d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.294126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd7b50-7a81-4faa-92ee-2f9d9dffa50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.356862 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-13bd7b50-7a81-4faa-92ee-2f9d9dffa50d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:09.358069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-13bd7b50-7a81-4faa-92ee-2f9d9dffa50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:09.452339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 671/1319] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:09.491051 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:09.492599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:09.595127 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ef9f7-adff-4264-aaf6-a33744bae42f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:09.668434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:09.669107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:09.669393 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:09.669674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:09.671316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:09.678683 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:09.780398 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:09.781870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146eb9a-cbde-409a-8aa6-837f0601db90 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:09.800642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 649/1320] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:12.505234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.505727 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.505857 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.507374 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 672/1321] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:12.512516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9eb3f-f431-48a9-8ee9-1acff527b532 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.512927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9eb3f-f431-48a9-8ee9-1acff527b532 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.513107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9eb3f-f431-48a9-8ee9-1acff527b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.580174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-96d9eb3f-f431-48a9-8ee9-1acff527b532 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:12.581477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-96d9eb3f-f431-48a9-8ee9-1acff527b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:12.641402 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.695016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 650/1322] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:12.731373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:12.732874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:12.753315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:12.843891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083b5d-1a0f-4780-8fa1-8bb84244abb1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:12.916452 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:12.917132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:12.917419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:12.917694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:12.919324 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:12.990049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:13.031279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:13.032710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a392f-e416-4138-af34-f9c28810a3dc service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:13.050595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 673/1323] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:15.150295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.150887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.150887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.152134 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 651/1324] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:15.157283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357597b0-5c24-4916-817a-04a771002b97 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.157704 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357597b0-5c24-4916-817a-04a771002b97 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.157974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357597b0-5c24-4916-817a-04a771002b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.224134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-357597b0-5c24-4916-817a-04a771002b97 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:15.225919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-357597b0-5c24-4916-817a-04a771002b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:15.324662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 674/1325] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:15.360595 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:15.362166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:15.467965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73134830-01fa-4068-8f94-6ccf0588d098 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:15.544064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:15.544717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:15.545043 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:15.545328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:15.547009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:15.565571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:15.663352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:15.664783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d335187-2361-4b12-b3d9-c676da7737f7 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:15.684202 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 652/1326] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:17.832617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.833176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.833176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.834565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 675/1327] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:17.839726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955e28-ee2c-4125-bdbf-8743356ba073 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:17.840152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955e28-ee2c-4125-bdbf-8743356ba073 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:17.840284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955e28-ee2c-4125-bdbf-8743356ba073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:17.907455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-98955e28-ee2c-4125-bdbf-8743356ba073 None None] MFA Rules not processed for user `fe78eae3bd8c4ef2bc2b7bc1e0dfa808`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:17.908676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-98955e28-ee2c-4125-bdbf-8743356ba073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:17.976537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:18.008764 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 653/1328] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:18.046493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:18.048072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:18.082087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:18.154506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aec3a-2ab6-419a-a640-dd8dd4222f60 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:18.227098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:18.227743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:18.228029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:18.228308 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:18.229990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:18.309709 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:18.341890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:18.343331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bafc6-657a-479a-abe4-350d9b5aa372 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:18.361641 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 676/1329] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:20.655982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2986dd-39f7-41b8-a3c1-c9d1d0dd50aa None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.656502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2986dd-39f7-41b8-a3c1-c9d1d0dd50aa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.656598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2986dd-39f7-41b8-a3c1-c9d1d0dd50aa None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.657973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 654/1330] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:20.663972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a9ff-74cf-47b6-ab6c-107e2455d53e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.664424 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a9ff-74cf-47b6-ab6c-107e2455d53e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.664553 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20a9ff-74cf-47b6-ab6c-107e2455d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.729716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bf20a9ff-74cf-47b6-ab6c-107e2455d53e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:20.730882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bf20a9ff-74cf-47b6-ab6c-107e2455d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:20.825479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 677/1331] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:31:20.877062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.877349 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.877630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 655/1332] 10.222.0.73 () {54 vars in 964 bytes} [Mon Jul 11 14:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:20.885251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9b43-4898-4eb9-b4a4-114037566115 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:20.885548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9b43-4898-4eb9-b4a4-114037566115 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:20.885831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9b43-4898-4eb9-b4a4-114037566115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:20.933047 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:20.964404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-de4c9b43-4898-4eb9-b4a4-114037566115 None None] MFA Rules not processed for user `36fa4087f9e348ea87a4d918a23b5660`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:20.965630 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de4c9b43-4898-4eb9-b4a4-114037566115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:21.042246 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 678/1333] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Jul 11 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:21.051117 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:21.052659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:21.155323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae67f2-eb54-45db-b7b4-1f72bb0d19be None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:21.227973 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:21.228620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:21.228932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:21.229214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:21.230854 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:21.258392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:21.337954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:21.339300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1f43-d659-4934-84cb-1a627ef4fd5c service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:21.358238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 656/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:23.661921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.662468 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.663099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.664474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 679/1335] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:23.669737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9b29-1034-45f1-99e0-8a0e1c769e6e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:23.670172 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9b29-1034-45f1-99e0-8a0e1c769e6e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:23.670296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9b29-1034-45f1-99e0-8a0e1c769e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:23.735023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-887b9b29-1034-45f1-99e0-8a0e1c769e6e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:23.736149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-887b9b29-1034-45f1-99e0-8a0e1c769e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:23.810285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:23.834361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 657/1336] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:23.874835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:23.876390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:23.978124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed4db8-fa8b-4c66-a96b-dcbc1d06d618 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:24.005983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:24.050383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:24.051026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:24.051313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:24.051590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:24.053814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:24.160296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:24.161748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b930e9-40b9-47c2-9028-6b296f6fcdec service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:24.180298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 680/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:26.844463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.845056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.845056 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.846473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 658/1338] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:26.852555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee995-befc-419d-9bfe-e315d149103e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:26.853008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee995-befc-419d-9bfe-e315d149103e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:26.853141 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee995-befc-419d-9bfe-e315d149103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:26.917353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f30ee995-befc-419d-9bfe-e315d149103e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:26.918574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f30ee995-befc-419d-9bfe-e315d149103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:26.927180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:27.014084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 681/1339] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:27.049595 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:27.051140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:27.153890 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d56c3-6d08-41c8-9369-7942c0912a61 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:27.229490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:27.230157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:27.230464 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:27.230742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:27.232635 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:27.268443 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:27.341242 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:27.342671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65b21a-d327-4f83-846e-909231262a52 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:27.363419 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 659/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:31.454215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:31.454771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:31.454771 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:31.456360 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 682/1341] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:31.462447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb66-8e1f-48c5-92e0-28541c0c328f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:31.462940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb66-8e1f-48c5-92e0-28541c0c328f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:31.463078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fb66-8e1f-48c5-92e0-28541c0c328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:31.529478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-ccc9fb66-8e1f-48c5-92e0-28541c0c328f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:31.530599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-ccc9fb66-8e1f-48c5-92e0-28541c0c328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:31.616149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:31.627653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 660/1342] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:31.666768 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:31.668301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:31.773789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decc3b1-ec11-428c-b080-f612dfe890d1 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:31.811602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:31.849546 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:31.850945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:31.851444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:31.851871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:31.853922 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:31.976469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:31.978114 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca28e62-f8e4-45e7-a3ce-13a136647d67 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:31.996951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 683/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:34.633252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:34.633873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:34.633873 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:34.635206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 661/1344] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:34.640950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef04d-e8e6-4baa-b71c-1f9618edbd2f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:34.641555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef04d-e8e6-4baa-b71c-1f9618edbd2f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:34.641555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef04d-e8e6-4baa-b71c-1f9618edbd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:34.712675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-82aef04d-e8e6-4baa-b71c-1f9618edbd2f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:34.713948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82aef04d-e8e6-4baa-b71c-1f9618edbd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:34.734368 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:34.813731 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 684/1345] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:31:34.851405 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:34.853054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:34.956824 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881770-c1c9-418e-b0ec-0ae83d24d99e None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:35.029350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:35.029914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:35.030195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:35.030469 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:35.032095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:35.074927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:35.141895 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:35.143399 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635941f3-bcf1-49cf-b9f0-3c74ca05daed service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:35.162459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 662/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:39.102783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:39.103294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:39.103294 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:39.104772 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 685/1347] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:39.110185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83227a-2700-48c6-a918-6fdcc313c605 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:39.110616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83227a-2700-48c6-a918-6fdcc313c605 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:39.110735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83227a-2700-48c6-a918-6fdcc313c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:39.176006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-0a83227a-2700-48c6-a918-6fdcc313c605 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:39.177818 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0a83227a-2700-48c6-a918-6fdcc313c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:39.273325 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:39.276080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 663/1348] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:39.314180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:39.315733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:39.449614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cba4ef-6c72-4cfb-b24c-6ce4a230cdc0 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:39.507284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:39.537140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:39.537809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:39.538096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:39.538387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:39.540582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:39.667613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:39.669113 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2f71b-ef81-405a-a43a-11e1425bd6dd service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:39.694110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 686/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:44.670610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e3d0-ab67-4f7e-b417-a88374870b64 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.671055 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e3d0-ab67-4f7e-b417-a88374870b64 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.671243 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e3d0-ab67-4f7e-b417-a88374870b64 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.672889 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 664/1350] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:44.679025 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003950-054d-4746-9ec0-43e19b69c2b1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:44.679412 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003950-054d-4746-9ec0-43e19b69c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:44.679504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003950-054d-4746-9ec0-43e19b69c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:44.792466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-a9003950-054d-4746-9ec0-43e19b69c2b1 None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:44.793968 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a9003950-054d-4746-9ec0-43e19b69c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:44.823521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:44.939295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 687/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:49.175946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea68b4-d57c-498c-925e-04ebf5a9a082 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:49.176479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea68b4-d57c-498c-925e-04ebf5a9a082 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:49.176564 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea68b4-d57c-498c-925e-04ebf5a9a082 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:49.178211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 665/1352] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:49.183078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725da6-a2eb-492a-b742-d79a6ca31269 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:49.183851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725da6-a2eb-492a-b742-d79a6ca31269 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:49.183851 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725da6-a2eb-492a-b742-d79a6ca31269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:49.262676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d9725da6-a2eb-492a-b742-d79a6ca31269 None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:49.264006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d9725da6-a2eb-492a-b742-d79a6ca31269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:49.346985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:49.387195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 688/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:50.824262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dfc62-6de0-41c5-acc0-f4ba84a5e194 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.824757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dfc62-6de0-41c5-acc0-f4ba84a5e194 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.824896 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dfc62-6de0-41c5-acc0-f4ba84a5e194 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.826397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 666/1354] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:50.831743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7b63-18b4-46cd-9a1b-8e78b9cfbbd6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:50.832190 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7b63-18b4-46cd-9a1b-8e78b9cfbbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:50.832531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff7b63-18b4-46cd-9a1b-8e78b9cfbbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:50.911985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f8ff7b63-18b4-46cd-9a1b-8e78b9cfbbd6 None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:50.913279 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f8ff7b63-18b4-46cd-9a1b-8e78b9cfbbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:51.029845 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 689/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:54.287942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767de0d-6098-4f7c-939b-57cdd53445b0 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.288462 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767de0d-6098-4f7c-939b-57cdd53445b0 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.288547 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767de0d-6098-4f7c-939b-57cdd53445b0 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.290678 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 667/1356] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:54.296222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1cc2-7964-4082-9b1b-4b6b528e7e22 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.297302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1cc2-7964-4082-9b1b-4b6b528e7e22 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.297798 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1cc2-7964-4082-9b1b-4b6b528e7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.339427 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:54.376144 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9dde1cc2-7964-4082-9b1b-4b6b528e7e22 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:54.377396 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9dde1cc2-7964-4082-9b1b-4b6b528e7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:54.491574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 690/1357] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:54.543518 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.543806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.544537 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.546093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 668/1358] 10.222.0.73 () {54 vars in 961 bytes} [Mon Jul 11 14:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:54.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4299a8-3c92-4362-9679-4e0d65e6bbec None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:54.554271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4299a8-3c92-4362-9679-4e0d65e6bbec None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:54.554560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4299a8-3c92-4362-9679-4e0d65e6bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:54.638021 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-bb4299a8-3c92-4362-9679-4e0d65e6bbec None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:54.639376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bb4299a8-3c92-4362-9679-4e0d65e6bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:54.691105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:54.764280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 691/1359] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Jul 11 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:31:54.773190 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:54.774719 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:54.926809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea66de-ab62-4106-9e22-2883be4f11d4 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:55.019739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:55.065037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807469b7-30e9-47e7-9134-507976710478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:55.065690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807469b7-30e9-47e7-9134-507976710478 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:55.065975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807469b7-30e9-47e7-9134-507976710478 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:55.066262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807469b7-30e9-47e7-9134-507976710478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:55.068454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-807469b7-30e9-47e7-9134-507976710478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:55.163776 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807469b7-30e9-47e7-9134-507976710478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:55.165519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807469b7-30e9-47e7-9134-507976710478 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:55.189042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 669/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:31:57.485076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:57.485499 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:57.485697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:57.487182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 692/1361] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:31:57.492488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7c36-219f-4e57-aa7f-d09adfbe29bd None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:57.492980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7c36-219f-4e57-aa7f-d09adfbe29bd None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:57.493316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7c36-219f-4e57-aa7f-d09adfbe29bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:57.571851 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b3de7c36-219f-4e57-aa7f-d09adfbe29bd None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:31:57.573345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b3de7c36-219f-4e57-aa7f-d09adfbe29bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:57.638484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:57.729099 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 670/1362] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:31:57.774438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:31:57.776134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:57.955678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a076a0-fd58-4b57-9a1f-71114b290542 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:31:57.967943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:31:58.082695 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:31:58.083350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:31:58.083639 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:31:58.083915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:31:58.085630 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:31:58.178895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:31:58.180627 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8759bd-f8ea-424b-86df-a1e88a896125 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:31:58.199869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 693/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:00.684371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e2dfa-ddfa-48e0-8563-fd696dad2037 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:00.684930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e2dfa-ddfa-48e0-8563-fd696dad2037 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:00.684930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e2dfa-ddfa-48e0-8563-fd696dad2037 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:00.686252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 671/1364] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:00.692287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba8ae-add3-461b-ae57-918fa6e86a3b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:00.692785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba8ae-add3-461b-ae57-918fa6e86a3b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:00.692972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba8ae-add3-461b-ae57-918fa6e86a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:00.709644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:00.769482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-07bba8ae-add3-461b-ae57-918fa6e86a3b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:00.771303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07bba8ae-add3-461b-ae57-918fa6e86a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:00.881183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 694/1365] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:00.924205 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:00.924618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:00.925042 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:00.927175 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 672/1366] 10.222.0.73 () {54 vars in 961 bytes} [Mon Jul 11 14:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:00.932670 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47259-1e2a-4555-abaf-564d0b9c0d4e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:00.933152 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47259-1e2a-4555-abaf-564d0b9c0d4e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:00.933439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47259-1e2a-4555-abaf-564d0b9c0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:01.014103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-62b47259-1e2a-4555-abaf-564d0b9c0d4e None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:01.015307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-62b47259-1e2a-4555-abaf-564d0b9c0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:01.054825 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:01.147786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 695/1367] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Jul 11 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:01.155762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:01.157338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:01.315559 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ca333-3e8c-4687-bda9-43221241f5ff None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:01.338091 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:01.437295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:01.438093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:01.438526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:01.438897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:01.440663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:01.544782 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:01.546684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e476609-8fd4-49fd-86e6-5fe8b39ec314 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:01.569268 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 673/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:02.588535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c122-5d13-4ca3-a9a6-a8cc1b78d3cc None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:02.589096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c122-5d13-4ca3-a9a6-a8cc1b78d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:02.589212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c122-5d13-4ca3-a9a6-a8cc1b78d3cc None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:02.590713 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 696/1369] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:02.595737 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef84d-b22e-48db-9f00-912ab4265c56 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:02.596144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef84d-b22e-48db-9f00-912ab4265c56 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:02.596330 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fef84d-b22e-48db-9f00-912ab4265c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:02.628367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:02.668505 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-35fef84d-b22e-48db-9f00-912ab4265c56 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:02.669765 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-35fef84d-b22e-48db-9f00-912ab4265c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:02.777009 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 674/1370] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:03.084629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.085072 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.085419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.087017 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 697/1371] 10.222.0.73 () {54 vars in 963 bytes} [Mon Jul 11 14:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:03.091882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa8df-365c-4348-bb6c-b34653ac7cb3 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.092163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa8df-365c-4348-bb6c-b34653ac7cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.092438 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fa8df-365c-4348-bb6c-b34653ac7cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.172320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f33fa8df-365c-4348-bb6c-b34653ac7cb3 None None] MFA Rules not processed for user `9f8fddb8437e4b058dc5891c0ef2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:03.173562 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f33fa8df-365c-4348-bb6c-b34653ac7cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.226308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:03.259608 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 675/1372] 10.222.0.73 () {58 vars in 1060 bytes} [Mon Jul 11 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:03.267748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:03.269444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.382645 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce03f3-0405-4944-b27c-b7166e077286 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:03.425973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:03.466488 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8fddb8437e4b058dc5891c0ef2937b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:03.467199 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.467486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.467761 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.469455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.609580 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:03.611255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f7191-b4d4-4e8c-9156-0cac4fb83fb4 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:03.633431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 698/1373] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:03.715649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.716092 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.716304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.718000 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 676/1374] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:03.725064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461369-b2c0-437c-ad01-b082e4ad77c1 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:03.725621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461369-b2c0-437c-ad01-b082e4ad77c1 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:03.727643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461369-b2c0-437c-ad01-b082e4ad77c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:03.796358 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-54461369-b2c0-437c-ad01-b082e4ad77c1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:03.797604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-54461369-b2c0-437c-ad01-b082e4ad77c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:03.818993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:03.931383 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 699/1375] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:03.987089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:03.989915 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:04.232048 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a2c7b-b393-40fb-9317-450273930a1a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:04.308863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:04.413912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:04.415880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:04.416787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:04.417645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:04.422633 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:04.580194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:04.582765 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5de3b-4ef0-4562-93b7-8187d7af2e71 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:04.603123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 677/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:06.756086 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:06.756619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:06.756619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:06.758079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 700/1377] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:06.763659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09416a-c2a4-4a2a-ab26-6f2df84db60e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:06.764195 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09416a-c2a4-4a2a-ab26-6f2df84db60e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:06.764282 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09416a-c2a4-4a2a-ab26-6f2df84db60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:06.837721 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-ef09416a-c2a4-4a2a-ab26-6f2df84db60e None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:06.838955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-ef09416a-c2a4-4a2a-ab26-6f2df84db60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:06.846304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:06.994358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 678/1378] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:07.040730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:07.042420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:07.201102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0afd99-98f5-4571-9822-2632d5aeb3e3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:07.205681 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:07.359671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:07.360970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:07.361397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:07.361882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:07.364943 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:07.494338 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:07.496353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe2e8-79bd-49fc-ae4b-eee5f5686852 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:07.527791 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 701/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:09.644771 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:09.645622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:09.645622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:09.647295 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 679/1380] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:09.652649 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9c83-ce6e-4a2d-a8ba-970cfeb6d406 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:09.653189 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9c83-ce6e-4a2d-a8ba-970cfeb6d406 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:09.653309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9c83-ce6e-4a2d-a8ba-970cfeb6d406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:09.664116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:09.725872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1acf9c83-ce6e-4a2d-a8ba-970cfeb6d406 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:09.727227 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1acf9c83-ce6e-4a2d-a8ba-970cfeb6d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:09.844517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 702/1381] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:09.896577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:09.898476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:10.057136 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:10.069108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00224e9-cd5b-4f9b-82b1-67eb5eeaf63b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:10.217992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:10.218659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:10.218938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:10.219215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:10.220930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:10.319059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:10.320699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d597a9-8e2e-4f7f-b35a-22eb96c3aaf9 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:10.332639 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:10.342037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 680/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:12.465999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:12.466722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:12.466722 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:12.467931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 703/1383] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:12.474804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbe6-b9ef-4b3f-b8ac-ae12ada2dddc None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:12.475449 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbe6-b9ef-4b3f-b8ac-ae12ada2dddc None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:12.475716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140dbe6-b9ef-4b3f-b8ac-ae12ada2dddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:12.571967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-5140dbe6-b9ef-4b3f-b8ac-ae12ada2dddc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:12.573819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5140dbe6-b9ef-4b3f-b8ac-ae12ada2dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:12.686745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 681/1384] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:12.750546 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:12.752502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:12.864484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:12.938905 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd70b6b-967a-4a36-884c-fe1a4418fcd3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:13.073747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:13.074354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:13.074619 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:13.074956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:13.076573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:13.141321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:13.187930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:13.189994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981217-58c2-4d5c-a919-db4ef56ed483 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:13.215554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 704/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:15.280928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:15.281618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:15.281618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:15.282894 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 682/1386] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:15.289032 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0686-798b-4c66-8339-45e6a426cd8c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:15.289821 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0686-798b-4c66-8339-45e6a426cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:15.289821 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0686-798b-4c66-8339-45e6a426cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:15.360073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-23cf0686-798b-4c66-8339-45e6a426cd8c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:15.361332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-23cf0686-798b-4c66-8339-45e6a426cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:15.468893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 705/1387] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:15.523414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:15.525013 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:15.623026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:15.736384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b8c5d-e9b3-4a0e-93b5-8975088e8631 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:15.889523 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:15.890234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:15.890655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:15.891006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:15.893153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:15.945544 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:16.019645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:16.022572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e2cf3-fc35-44a4-a1b1-7a63d0b8001c service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:16.052479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 683/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:18.179030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.179594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.179594 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.180990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 706/1389] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:18.186293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec0b9-bb27-4280-b206-4ed2f7c1e341 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.186941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec0b9-bb27-4280-b206-4ed2f7c1e341 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.186941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec0b9-bb27-4280-b206-4ed2f7c1e341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.255138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-414ec0b9-bb27-4280-b206-4ed2f7c1e341 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:18.256344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-414ec0b9-bb27-4280-b206-4ed2f7c1e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.362490 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 684/1390] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:18.406917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:18.408415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.439422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:18.559811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994e7f-e8a6-4c1f-a09a-30acf17fb3e8 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:18.661073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:18.673118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:18.673765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:18.674046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:18.674320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:18.676603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:18.766454 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:18.768049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71723f42-9b47-4541-ad5d-5decb4f57ef1 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:18.787335 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 707/1391] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:19.243104 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422fc6-15c5-4c99-8917-087d43416468 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:19.243681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422fc6-15c5-4c99-8917-087d43416468 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:19.243681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422fc6-15c5-4c99-8917-087d43416468 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:19.245054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 685/1392] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:19.250422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d169-7186-4b5e-8f5b-92768efbe9e8 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:19.250864 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d169-7186-4b5e-8f5b-92768efbe9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:19.250980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d169-7186-4b5e-8f5b-92768efbe9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:19.316616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4728d169-7186-4b5e-8f5b-92768efbe9e8 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:19.317848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4728d169-7186-4b5e-8f5b-92768efbe9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:19.383858 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:19.423870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 708/1393] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:19.479794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:19.480088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:19.480373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:19.482093 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 686/1394] 10.222.0.73 () {54 vars in 962 bytes} [Mon Jul 11 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:19.487213 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b9ef-a9ae-4eb2-bac0-9727db53333f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:19.487506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b9ef-a9ae-4eb2-bac0-9727db53333f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:19.487784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4b9ef-a9ae-4eb2-bac0-9727db53333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:19.563320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b3f4b9ef-a9ae-4eb2-bac0-9727db53333f None None] MFA Rules not processed for user `992d3b61b59d4208be7396a153d6231e`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:19.564479 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b3f4b9ef-a9ae-4eb2-bac0-9727db53333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:19.641770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 709/1395] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Jul 11 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:19.650046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:19.651552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:19.665037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:19.756379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed86b1d-49ce-4fe8-8973-4ef776b9e6d4 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:19.830785 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d3b61b59d4208be7396a153d6231e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:19.831403 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:19.831692 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:19.831970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:19.833666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:19.906474 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:19.951006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:19.952435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2fb94-0e31-456c-bd2d-83181b1c1688 service glance] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:19.971132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 687/1396] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:20.686602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a02b8-1f3b-4cef-ae73-79ace83ea082 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.687079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a02b8-1f3b-4cef-ae73-79ace83ea082 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.687193 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a02b8-1f3b-4cef-ae73-79ace83ea082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.754416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-ca5a02b8-1f3b-4cef-ae73-79ace83ea082 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:20.755666 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ca5a02b8-1f3b-4cef-ae73-79ace83ea082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:20.764999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:20.858310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 710/1397] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:20.864096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9dc2-bfc1-4618-b12f-2080fda2606b None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.864592 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9dc2-bfc1-4618-b12f-2080fda2606b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.864699 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9dc2-bfc1-4618-b12f-2080fda2606b None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.866224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 688/1398] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:20.871379 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.871674 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.871955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.906690 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c1bc-9def-45a5-9654-b299d1810dff None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.907253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c1bc-9def-45a5-9654-b299d1810dff None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.907541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c1bc-9def-45a5-9654-b299d1810dff None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.908958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 689/1399] 10.222.0.73 () {54 vars in 942 bytes} [Mon Jul 11 14:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:32:20.916131 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:20.916424 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:20.916710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:20.939952 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:20.941186 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:20.993407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] MFA Rules not processed for user `810cd1c21e2d4f379b02b91885be1882`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:20.994607 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.039285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 711/1400] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:21.082680 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.084000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.086613 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.101691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 690/1401] 10.222.0.73 () {58 vars in 1039 bytes} [Mon Jul 11 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:21.112086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:21.117820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.123961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2c487-4c98-4e87-8af1-84a32e4ebd48 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.204519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9058a4-e624-49e9-9e5f-402ef1b7fbbc None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:21.231027 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.231676 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.231961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.232234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.233983 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.318535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:21.320844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.321463 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:21.322130 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:21.322497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa174-4351-4798-bb15-fbe37144824b service swift] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.322677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:21.323205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:21.325123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:21.330939 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 691/1402] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:32:21.429535 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:21.431093 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9d355-bbd9-4338-ae11-017fe9b4bbb0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:21.453782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 712/1403] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:32:23.601733 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:23.602345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:23.602452 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:23.604272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 692/1404] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:23.610938 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117cb2-a6b2-47d6-8c78-58f0c521263c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:23.611470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117cb2-a6b2-47d6-8c78-58f0c521263c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:23.611470 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57117cb2-a6b2-47d6-8c78-58f0c521263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:23.685124 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-57117cb2-a6b2-47d6-8c78-58f0c521263c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:23.686339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-57117cb2-a6b2-47d6-8c78-58f0c521263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:23.768003 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:23.806915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 713/1405] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:23.852294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:23.853866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:23.891342 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:24.043918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bea4-3eed-4670-925d-add3f102c89b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:24.193736 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:24.208187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:24.208949 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:24.209240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:24.209584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:24.211631 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:24.325439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:24.326946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df0053-ca60-401d-82b8-f93c2297791f service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:24.351081 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 693/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:26.466804 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.467385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.467385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.468824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 714/1407] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:26.474584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e345-0a03-4ff9-9b37-47d629d2678a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:26.475111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e345-0a03-4ff9-9b37-47d629d2678a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:26.475111 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6e345-0a03-4ff9-9b37-47d629d2678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:26.566491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-fef6e345-0a03-4ff9-9b37-47d629d2678a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:26.568666 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-fef6e345-0a03-4ff9-9b37-47d629d2678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:26.658709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:26.702696 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 694/1408] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:26.751501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:26.753683 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:26.967050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7d81-eb82-46a7-a93b-adcaa4025374 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:27.077685 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:27.168516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:27.169219 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:27.169506 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:27.169783 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:27.171500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:27.308972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:27.310928 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a65c34-8685-4403-b125-cdaed16bb224 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:27.335741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 715/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:36.703112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=14 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:37.332587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=73 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:44.413604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afc99-447b-45db-ad1d-5b6f0d25a17d None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.414214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afc99-447b-45db-ad1d-5b6f0d25a17d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.414214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afc99-447b-45db-ad1d-5b6f0d25a17d None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.415588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 695/1410] 10.222.0.73 () {54 vars in 918 bytes} [Mon Jul 11 14:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:44.420868 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0653c-8f12-4ea6-a05f-6cb8b90d8b48 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.421519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0653c-8f12-4ea6-a05f-6cb8b90d8b48 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.421519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0653c-8f12-4ea6-a05f-6cb8b90d8b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.520343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-62a0653c-8f12-4ea6-a05f-6cb8b90d8b48 None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:44.521753 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-62a0653c-8f12-4ea6-a05f-6cb8b90d8b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:44.626299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 716/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Jul 11 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:44.641209 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348ed7-2bbd-4f50-809e-42125e37d938 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.641498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348ed7-2bbd-4f50-809e-42125e37d938 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.641784 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50348ed7-2bbd-4f50-809e-42125e37d938 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.643197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 696/1412] 10.222.0.73 () {54 vars in 918 bytes} [Mon Jul 11 14:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:44.648087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da929-3820-4b27-8d02-06f46870681d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:44.648388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da929-3820-4b27-8d02-06f46870681d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:44.648669 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da929-3820-4b27-8d02-06f46870681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:44.719316 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:44.722725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f29da929-3820-4b27-8d02-06f46870681d None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:44.724676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f29da929-3820-4b27-8d02-06f46870681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:44.846686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 717/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Jul 11 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:47.395877 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.396442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.396442 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.397870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:47.403030 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953efa-df86-4434-a6eb-2a8e80788263 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.403422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953efa-df86-4434-a6eb-2a8e80788263 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.403599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953efa-df86-4434-a6eb-2a8e80788263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.467958 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-34953efa-df86-4434-a6eb-2a8e80788263 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:47.469377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-34953efa-df86-4434-a6eb-2a8e80788263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.525493 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.567073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:47.609444 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:47.611340 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.756401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b54c-8909-4ca1-87a7-1e82b4fd6b1c None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:47.827404 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:47.867775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:47.868420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:47.868708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:47.869022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:47.870682 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:47.959367 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:47.960991 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434cadf-35f7-4755-adcd-e74625da1d3f service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:47.978502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 698/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:48.890807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.891337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.891337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.893309 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:48.898590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc36f1-e2e4-4a0c-a34c-5d3133f054bb None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:48.899125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc36f1-e2e4-4a0c-a34c-5d3133f054bb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:48.899125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc36f1-e2e4-4a0c-a34c-5d3133f054bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:48.973587 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-58bc36f1-e2e4-4a0c-a34c-5d3133f054bb None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:48.974805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-58bc36f1-e2e4-4a0c-a34c-5d3133f054bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:49.003477 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.073489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:49.223995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:49.225459 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:49.372830 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842287e0-b344-4f0c-903a-43e1b438c6c5 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:49.412284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:49.487523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:49.488176 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:49.488462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:49.488739 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:49.490422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:49.578272 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:49.579876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0ed4-c523-412f-8486-362a0fd541d7 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:49.598278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 720/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:50.493471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.493938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.494053 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.495455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:50.500280 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ac80-167b-4bc8-a678-d96725b05d69 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:50.500702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ac80-167b-4bc8-a678-d96725b05d69 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:50.500840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ac80-167b-4bc8-a678-d96725b05d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:50.554578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:50.576735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-33f1ac80-167b-4bc8-a678-d96725b05d69 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:50.577964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-33f1ac80-167b-4bc8-a678-d96725b05d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:50.675361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:32:50.824355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:50.825869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:50.975701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516253c-b49d-4ed9-83cb-87391cc579d6 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:50.988778 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:51.110702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:51.112260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:51.112545 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:51.112942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:51.115323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:51.241626 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:51.244151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6476d-ab31-48ce-9c00-5c233b4cf16f service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:51.271180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 701/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:52.139065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.139637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.139637 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.140878 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:52.146084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302685ef-7e62-4494-9a01-0b1c0d1ccda4 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.146534 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302685ef-7e62-4494-9a01-0b1c0d1ccda4 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.146643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302685ef-7e62-4494-9a01-0b1c0d1ccda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.164611 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.226668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-302685ef-7e62-4494-9a01-0b1c0d1ccda4 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:52.227908 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-302685ef-7e62-4494-9a01-0b1c0d1ccda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:52.333361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:52.485614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:52.487708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:52.599214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.636061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b1e3f-cba1-4d57-af39-43e0e83c5a7c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:52.756326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:52.756909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:52.757198 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:52.757473 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:52.759120 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:52.835971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:52.850701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:52.851880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd400c-5d0e-4472-a802-70a5e685d2c0 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:52.869970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 723/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:53.729334 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.729866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.729866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.731219 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:53.736346 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3d00-033d-4339-b464-a28923e6da1b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:53.736821 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3d00-033d-4339-b464-a28923e6da1b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:53.737025 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae3d00-033d-4339-b464-a28923e6da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:53.811187 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-98ae3d00-033d-4339-b464-a28923e6da1b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:53.812395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-98ae3d00-033d-4339-b464-a28923e6da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:53.910256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:54.065932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:54.067410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:54.153138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.216155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a89b-6e2e-40e4-949e-9df1c2365156 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:54.345914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:54.346486 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:54.346774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:54.347054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:54.348727 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:54.398668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:54.439888 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:54.441577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236fc65-abb1-4a5a-9403-732c9ec421b3 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:54.461217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 704/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:55.265022 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.265590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.265590 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.266995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:55.272385 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcdad6-da94-4618-8d0b-25bb02df5282 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.272911 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcdad6-da94-4618-8d0b-25bb02df5282 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.273021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcdad6-da94-4618-8d0b-25bb02df5282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.351717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-48bcdad6-da94-4618-8d0b-25bb02df5282 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:55.352988 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-48bcdad6-da94-4618-8d0b-25bb02df5282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:55.452039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:55.601084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:55.602609 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:55.651846 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:55.752677 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157287-3c11-48c6-bc83-91a0f2c37412 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:55.863523 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:55.864172 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:55.864455 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:55.864730 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:55.866404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:55.873367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:55.957606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:55.959237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cf002-2102-41ca-a022-c6a0fcef7d91 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:55.977013 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 726/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:56.791401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.791976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.791976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.793352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:56.798810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60550-60ac-4d9b-bdfe-3479d4909156 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:56.799214 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60550-60ac-4d9b-bdfe-3479d4909156 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:56.799373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60550-60ac-4d9b-bdfe-3479d4909156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:56.882394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5ad60550-60ac-4d9b-bdfe-3479d4909156 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:56.883657 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ad60550-60ac-4d9b-bdfe-3479d4909156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:56.951540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:56.981515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:57.135461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:57.136981 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:57.155052 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.287783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fcd3d-571b-40a8-813a-00b409ed86d6 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:57.376716 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:57.404054 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:57.404629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:57.404948 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:57.405229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:57.406891 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:57.511571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:57.513284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf756ddf-4822-4d04-8b50-943bf423a0d3 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:57.534152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 707/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:58.370486 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.371076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.371076 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.372422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:58.378560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb93d-c7ed-49cb-8988-7400fa1d7a9b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.379152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb93d-c7ed-49cb-8988-7400fa1d7a9b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:58.379152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb93d-c7ed-49cb-8988-7400fa1d7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:58.459401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-95bdb93d-c7ed-49cb-8988-7400fa1d7a9b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:32:58.460972 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-95bdb93d-c7ed-49cb-8988-7400fa1d7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:58.517944 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.576234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:32:58.726898 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:58.728536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:58.878566 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc50b-98d5-42f2-b9b7-8df678f5b512 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:58.931869 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:58.998984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:58.999636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:58.999926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.000206 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.002623 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:59.102320 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:59.103903 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17170f3-23c5-4ad4-92e3-0c5335d54c0f service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:59.122270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 729/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:59.931079 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.931606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.931606 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:59.933455 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:32:59.938282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc33af-9927-4282-81db-29161cfdd9b2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:59.939201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc33af-9927-4282-81db-29161cfdd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:59.939384 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc33af-9927-4282-81db-29161cfdd9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.021926 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-94fc33af-9927-4282-81db-29161cfdd9b2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:00.023126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-94fc33af-9927-4282-81db-29161cfdd9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.025157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.124962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:00.277183 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:00.278904 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.550622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c25bd1-d9bf-49cb-b906-fbd3f0c36fd6 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:00.577454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:00.666743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:00.667401 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:00.667688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:00.667965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:00.669701 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:00.759519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:00.761157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631d921-3f9e-4f7b-a982-ce51e47f9607 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:00.779320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 710/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:02.723806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.724433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.724433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.725774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:02.731328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972627-c761-4ed6-9670-f512624a770b None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:02.731783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972627-c761-4ed6-9670-f512624a770b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:02.731881 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e972627-c761-4ed6-9670-f512624a770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:02.776774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:02.803866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-7e972627-c761-4ed6-9670-f512624a770b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:02.805101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7e972627-c761-4ed6-9670-f512624a770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:02.901651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:02.941295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:02.942822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:03.060087 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab875355-e2cd-4df2-82b7-4f348c5ef82a None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:03.093060 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:03.138604 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:03.139260 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:03.139544 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:03.139820 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:03.141602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:03.256608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:03.258085 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2efd9-ef71-40ff-8e14-1f09fad59181 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:03.276361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 732/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:05.522288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.522811 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.522931 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.524278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:05.529675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ae70-f0ee-4f04-be65-68433f71f811 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.530106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ae70-f0ee-4f04-be65-68433f71f811 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.530217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ae70-f0ee-4f04-be65-68433f71f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.593243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9d20ae70-f0ee-4f04-be65-68433f71f811 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:05.594445 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9d20ae70-f0ee-4f04-be65-68433f71f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.607270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.691652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:33:05.728524 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:05.730064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:05.831555 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6beb7-27e5-49df-90ab-148a719b01f3 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:05.843363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:05.904546 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:05.905221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:05.905507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:05.905783 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:05.907978 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:06.014762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:06.016112 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e63ac-720d-418f-89e8-e711f486a506 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:06.034994 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 713/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:08.360819 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.361439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.361439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.362786 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:08.368196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b995-578a-4d54-a624-0c53073dbbfb None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.368623 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b995-578a-4d54-a624-0c53073dbbfb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.368780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768b995-578a-4d54-a624-0c53073dbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.414640 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.436196 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-7768b995-578a-4d54-a624-0c53073dbbfb None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:08.438641 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-7768b995-578a-4d54-a624-0c53073dbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.537482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:08.575693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:08.577268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.681675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7df08e-3a13-4629-b7cf-261621680520 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:08.721972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:08.756434 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:08.757134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:08.757422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:08.757701 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:08.759418 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:08.868408 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:08.869872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab287ae-952e-4dd0-a06e-cc4a002ed8ce service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:08.888278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 735/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:11.061966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.062502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.062595 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.064558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:11.070002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726640-1ec1-4d10-857a-ab4fefbfa613 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.070420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726640-1ec1-4d10-857a-ab4fefbfa613 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.070578 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726640-1ec1-4d10-857a-ab4fefbfa613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.140058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9e726640-1ec1-4d10-857a-ab4fefbfa613 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:11.141349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9e726640-1ec1-4d10-857a-ab4fefbfa613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.167795 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.244081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:11.282878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:11.284423 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.388838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1c48c-6ebf-46b3-b42e-64e54e60dfd0 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:11.408957 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:11.467128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13091988-9351-48de-b866-618709384ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:11.468316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091988-9351-48de-b866-618709384ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:11.468316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091988-9351-48de-b866-618709384ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:11.468316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13091988-9351-48de-b866-618709384ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:11.470060 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-13091988-9351-48de-b866-618709384ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:11.583379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13091988-9351-48de-b866-618709384ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:11.584793 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13091988-9351-48de-b866-618709384ac7 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:11.602604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 716/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:13.698516 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.699035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.699158 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.700559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:13.706461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b61e5-08f2-4255-aa2e-75a65ada29ad None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:13.706877 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b61e5-08f2-4255-aa2e-75a65ada29ad None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:13.707035 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b61e5-08f2-4255-aa2e-75a65ada29ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:13.768730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:13.772001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-361b61e5-08f2-4255-aa2e-75a65ada29ad None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:13.773660 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-361b61e5-08f2-4255-aa2e-75a65ada29ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:13.875902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:13.914388 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:13.915927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.018428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d602e-7dde-4e1e-9381-fb8c9506cb12 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:14.066139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:14.090694 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:14.091310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:14.091593 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:14.091865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:14.093534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:14.207990 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:14.209612 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd779483-0013-43a2-80ec-afb3f1dcddbf service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:14.227169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 738/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:16.374472 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f933-3161-4165-801f-6343343db817 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.375044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f933-3161-4165-801f-6343343db817 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.375044 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f933-3161-4165-801f-6343343db817 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.377085 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:16.382307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eae66-6835-420c-9ad6-2ded66d46e71 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.382747 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eae66-6835-420c-9ad6-2ded66d46e71 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.382909 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eae66-6835-420c-9ad6-2ded66d46e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.450951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-451eae66-6835-420c-9ad6-2ded66d46e71 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:16.452175 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-451eae66-6835-420c-9ad6-2ded66d46e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:16.482006 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:16.548792 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:16.588768 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f933-3161-4165-801f-6343343db817 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:16.590326 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0899f933-3161-4165-801f-6343343db817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:16.695637 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f933-3161-4165-801f-6343343db817 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:16.725876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:16.771220 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:16.771865 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:16.772152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:16.772429 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:16.774240 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:16.886155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:16.887610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ea151-e078-445c-98fc-0cfa0fa05b4c service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:16.906426 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 719/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:18.976215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.976939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.976939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:18.978175 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:18.983560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520f6f-ad47-4d28-bc0d-3bf109441c8c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:18.983961 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520f6f-ad47-4d28-bc0d-3bf109441c8c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:18.984117 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520f6f-ad47-4d28-bc0d-3bf109441c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.048258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b4520f6f-ad47-4d28-bc0d-3bf109441c8c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:19.049498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b4520f6f-ad47-4d28-bc0d-3bf109441c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:19.057740 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.146802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:19.184465 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:19.186101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:19.288264 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa55ea-15ae-4b1a-94b3-d69006a6c693 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:19.345597 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:19.364375 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:19.365053 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:19.365357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:19.365618 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:19.367296 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:19.486345 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:19.487778 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece534d3-24eb-4ff6-9a71-e9e1173d161d service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:19.505899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 741/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:21.600772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.601336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.601336 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.602774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:21.607922 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3379-d1ea-4447-91ac-371dcb655dfc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.608337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3379-d1ea-4447-91ac-371dcb655dfc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.608480 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3379-d1ea-4447-91ac-371dcb655dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.673543 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-b05e3379-d1ea-4447-91ac-371dcb655dfc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:21.674755 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b05e3379-d1ea-4447-91ac-371dcb655dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:21.712321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.770751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:21.808941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:21.810552 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:21.920810 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab12ee-021c-4fe4-a548-1ed1a043cb01 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:21.957560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:21.995397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:21.996040 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:21.996322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:21.996596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:21.998267 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:22.106125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:22.107470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696eeb-d4e6-4287-ba9e-376769a33c9b service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:22.125802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 722/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:24.181435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.182008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.182008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.183391 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:24.189252 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fc12-c60a-4647-9418-0bf54afd3aef None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.189643 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fc12-c60a-4647-9418-0bf54afd3aef None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.189829 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fc12-c60a-4647-9418-0bf54afd3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.254940 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-2709fc12-c60a-4647-9418-0bf54afd3aef None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:24.256146 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-2709fc12-c60a-4647-9418-0bf54afd3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:24.274248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.352323 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:24.390824 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:24.392447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:24.502650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a21ea1-11b2-43a2-8b38-89672a46ca31 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:24.568090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:24.575128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:24.575777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:24.576064 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:24.576344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:24.578056 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:24.686318 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:24.687746 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a8e2-cfba-4ee6-9956-c66641b5b0a1 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:24.706211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 744/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:26.763289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.763289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.763942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.764769 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:26.771128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5ec9-7636-4965-8287-9aa6b771ebc2 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:26.771554 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5ec9-7636-4965-8287-9aa6b771ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:26.771686 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5ec9-7636-4965-8287-9aa6b771ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:26.838720 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-944f5ec9-7636-4965-8287-9aa6b771ebc2 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:26.839951 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-944f5ec9-7636-4965-8287-9aa6b771ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:26.898088 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:26.951708 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:26.988304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:26.989887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.094197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731dd0f-c45b-446e-bce1-af5cbefb7d9f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:27.142588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:27.170226 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:27.170875 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:27.171159 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:27.171433 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:27.173684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:27.282600 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:27.283927 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c6913-bf6f-4808-84b1-e1c4240ca54a service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:27.301729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 725/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:36.949405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=22 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:37.299391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=66 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.317721 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a2b4-b324-4284-ac22-07b274016b4b None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.318295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a2b4-b324-4284-ac22-07b274016b4b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.318295 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a2b4-b324-4284-ac22-07b274016b4b None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.319681 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 746/1471] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:47.324960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda18a-4e3f-4072-b55a-87d1e45bf4aa None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.325475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda18a-4e3f-4072-b55a-87d1e45bf4aa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.325576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda18a-4e3f-4072-b55a-87d1e45bf4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.388016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-cdcda18a-4e3f-4072-b55a-87d1e45bf4aa None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:47.389238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-cdcda18a-4e3f-4072-b55a-87d1e45bf4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:47.485947 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 726/1472] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:47.569596 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.569835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.570121 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.571502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 747/1473] 10.222.0.73 () {54 vars in 962 bytes} [Mon Jul 11 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:47.576371 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc2734-a795-4ec5-bca1-3a9abef3da7c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.576661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc2734-a795-4ec5-bca1-3a9abef3da7c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.576980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc2734-a795-4ec5-bca1-3a9abef3da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.650414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-f3cc2734-a795-4ec5-bca1-3a9abef3da7c None None] MFA Rules not processed for user `992d3b61b59d4208be7396a153d6231e`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:47.651059 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-f3cc2734-a795-4ec5-bca1-3a9abef3da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:47.675359 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:47.732672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 727/1474] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Jul 11 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:47.741233 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:47.742754 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:47.845230 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08329bc-3354-425e-98a5-dd553b912f20 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:47.916524 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d3b61b59d4208be7396a153d6231e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:47.917197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:47.917485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:47.917763 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:47.919416 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:47.979582 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:48.035117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:48.036555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd30c26-4cd5-4982-8f44-ab77f02a4a20 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:48.055161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 748/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:33:50.182425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.183067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.183067 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.184360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 728/1476] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:33:50.189675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4547dc-b8d4-4ad8-aa13-2afbfc0daf44 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.190139 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4547dc-b8d4-4ad8-aa13-2afbfc0daf44 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.190270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4547dc-b8d4-4ad8-aa13-2afbfc0daf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.254888 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-4d4547dc-b8d4-4ad8-aa13-2afbfc0daf44 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:50.256108 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4d4547dc-b8d4-4ad8-aa13-2afbfc0daf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:50.353270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 749/1477] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:50.377763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:50.379269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:50.504563 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be3948-fce5-4544-bdf6-0f59635e1420 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:50.553064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:50.597319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:50.597976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:50.598256 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:50.598529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:50.599266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:50.601006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:33:50.601006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:33:50.601006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:33:50.602124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54dd79-c7ea-4da0-905a-29822a2c5ee5 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:50.621194 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 729/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Jul 11 14:33:50 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:33:52.657382 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.657977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.657977 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.659332 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 750/1479] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:52.664501 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12908-163b-45a1-aac0-a0c8a4c9e952 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:52.664962 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12908-163b-45a1-aac0-a0c8a4c9e952 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:52.665073 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12908-163b-45a1-aac0-a0c8a4c9e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:52.743902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-11b12908-163b-45a1-aac0-a0c8a4c9e952 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:52.745319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-11b12908-163b-45a1-aac0-a0c8a4c9e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:52.841550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 730/1480] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:52.884570 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:52.886132 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:52.896128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.032775 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39523009-9b81-45fe-8bc5-a67aa1125a00 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:53.114387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:53.146577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:53.147234 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:53.147521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:53.147799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:53.149521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:53.245353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:53.247002 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cc31-3f4c-4c1b-9297-c63be8d37f28 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:53.264870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 751/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:55.490756 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.491343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.491343 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.492708 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 731/1482] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:55.498103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12c-6d22-4c9f-8b94-cc8f91d4151c None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.498537 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12c-6d22-4c9f-8b94-cc8f91d4151c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.498644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12c-6d22-4c9f-8b94-cc8f91d4151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.562366 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-960be12c-6d22-4c9f-8b94-cc8f91d4151c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:55.563557 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-960be12c-6d22-4c9f-8b94-cc8f91d4151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:55.607860 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.658428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 752/1483] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:55.694728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:55.696258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:55.720488 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.800156 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050dfbe-24f9-45ce-ba05-a5c16d5f186a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:55.871338 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:55.871974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:55.872253 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:55.872530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:55.874203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:55.946528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:55.981679 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:55.983108 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e49c4-8738-4ffe-ab83-64a54d1f7b5f service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:56.000590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 732/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:33:58.090816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.091315 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.091428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.092809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 753/1485] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:33:58.098140 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc5f4-6121-443d-a36d-53d8324b9860 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.098596 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc5f4-6121-443d-a36d-53d8324b9860 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.098702 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc5f4-6121-443d-a36d-53d8324b9860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.162912 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-97fbc5f4-6121-443d-a36d-53d8324b9860 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:33:58.164130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-97fbc5f4-6121-443d-a36d-53d8324b9860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:58.259651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 733/1486] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:33:58.297841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:33:58.299420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:58.404437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c99ca-7a7c-4e89-9196-91d15e52c4c6 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:33:58.477545 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:33:58.479716 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:33:58.480564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:33:58.481071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:33:58.481368 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:33:58.484016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:33:58.590444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:33:58.591865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581eb87-8803-4a39-827a-bc591a51ee3e service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:33:58.610502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 754/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:00.838820 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.839392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.839392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.840826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 734/1488] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:00.846212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf8c5-46e2-4171-8831-025e1d0cb3c3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:00.846614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf8c5-46e2-4171-8831-025e1d0cb3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:00.846784 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf8c5-46e2-4171-8831-025e1d0cb3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:00.910629 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-813cf8c5-46e2-4171-8831-025e1d0cb3c3 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:00.911840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-813cf8c5-46e2-4171-8831-025e1d0cb3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:00.963429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.008448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 755/1489] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:01.049617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:01.051139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:01.086726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.156169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8b2d-863d-4dc4-a8c6-5a78bf5f0bd0 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:01.229938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:01.230594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:01.230876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:01.231154 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:01.232806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:01.314700 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:01.343954 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:01.345432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4178907-3bed-4be7-9b14-b2d814cb997c service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:01.364314 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 735/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:03.587663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.588211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.588211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.589702 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 756/1491] 10.222.0.73 () {54 vars in 926 bytes} [Mon Jul 11 14:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:34:03.595495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5611-174a-4190-be8b-dc2532e281a1 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.596133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5611-174a-4190-be8b-dc2532e281a1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.596394 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce5611-174a-4190-be8b-dc2532e281a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.660183 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-adce5611-174a-4190-be8b-dc2532e281a1 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:34:03.661415 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-adce5611-174a-4190-be8b-dc2532e281a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:03.756299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 736/1492] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Jul 11 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:34:03.794971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:34:03.797210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:03.897974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8e91-ae2d-4233-a524-e2661abde157 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:34:03.970959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:34:03.971601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:34:03.971883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:34:03.972156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:34:03.973832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:34:03.983835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:04.200533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:34:04.202444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a517-a813-4b70-ae60-b0458d83e4a2 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:34:04.223494 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 757/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:34:13.754458 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=82 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:34:14.220347 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=50 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:38.438234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:38.438869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:38.438869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:38.513938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:38.515130 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:38.612902 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 737/1494] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:38.621964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:38.622497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:38.622497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:38.695197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:38.696334 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:38.789826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 758/1495] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:38.795089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:38.796296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:38.808389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aee6ab-dfc0-44b6-9077-ee311bcd3c33 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:38.878535 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:38.912199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:38.912883 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:38.913167 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:38.913445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:38.914179 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:35:38.914489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:38.915502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:38.915502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:35:38.915502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:35:38.916958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:38.928822 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 738/1496] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Jul 11 14:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:35:38.937955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:38.947770 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68598b9-a704-4590-96e0-9ea5d5935d14 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.007984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:39.041417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.042079 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.042367 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.042643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.043340 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.045106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:39.045106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:35:39.045106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:35:39.046287 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.100924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 759/1497] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Jul 11 14:35:38 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:35:39.105096 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:39.106622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.141827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16992-ed3b-4712-ae33-79ccd24c7d33 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.237020 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.237691 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.237975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.238249 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.238933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.240062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:39.240062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:35:39.240062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:35:39.241296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.281313 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 739/1498] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Jul 11 14:35:39 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:35:39.285457 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:39.286994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.348955 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c26d5-61cd-4fcc-8246-12776d21849a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.432281 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:39.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.444572 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.444874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.445170 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.445906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.446924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:39.446924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:35:39.446924 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:35:39.447799 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.460274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 760/1499] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:35:39.464335 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:39.465876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.479560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b297c-10e4-4430-9e7c-05b877578d63 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.505803 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:39.576924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.577926 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.578420 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.578887 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.579644 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.580674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:39.580674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:35:39.580674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:35:39.581598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fba18c-7865-4cf4-b1d7-54b0c6120ff8 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.594965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 740/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:35:39.599363 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:39.600956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.634312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823b86-1baf-4678-985b-ccfc6bf97bf7 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:39.734195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:39.735081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.735357 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.735644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] PATH_INFO: `/v3/projects/1b8ef644671943c4b9db4fb470ca8925/users/2618331439be481d8f0c4578b6b893eb/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.757895 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8ef644671943c4b9db4fb470ca8925, user_id=2618331439be481d8f0c4578b6b893eb, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:39.758838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:39.758838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:35:39.758838 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:35:39.760841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9be44-77f4-423f-8a41-e0e325e495f5 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:39.787779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 761/1501] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:35:39 2022] PUT /identity/v3/projects/1b8ef644671943c4b9db4fb470ca8925/users/2618331439be481d8f0c4578b6b893eb/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:35:39.800664 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fb2c-9044-4018-8f87-7df41005107e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.800996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fb2c-9044-4018-8f87-7df41005107e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.801278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2fb2c-9044-4018-8f87-7df41005107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.855601 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a1a2fb2c-9044-4018-8f87-7df41005107e None None] MFA Rules not processed for user `2618331439be481d8f0c4578b6b893eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:39.856794 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a1a2fb2c-9044-4018-8f87-7df41005107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:39.933861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 741/1502] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:39.947902 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.948193 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.948469 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.949927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 762/1503] 10.222.0.73 () {54 vars in 963 bytes} [Mon Jul 11 14:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:39.955215 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf194-1a91-4ec0-92c7-6fc2cb1f766e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:39.955507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf194-1a91-4ec0-92c7-6fc2cb1f766e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:39.955790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf194-1a91-4ec0-92c7-6fc2cb1f766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:39.986990 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:40.032078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b2eaf194-1a91-4ec0-92c7-6fc2cb1f766e None None] MFA Rules not processed for user `9f8fddb8437e4b058dc5891c0ef2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:40.033229 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b2eaf194-1a91-4ec0-92c7-6fc2cb1f766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:40.107780 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 742/1504] 10.222.0.73 () {58 vars in 1060 bytes} [Mon Jul 11 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:40.115467 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:40.117031 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:40.167768 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:40.223192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaf6ea-cc98-4dc4-83e7-3a80bb0c228f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:40.296013 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8fddb8437e4b058dc5891c0ef2937b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:40.296588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:40.296899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:40.297184 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:40.298837 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:40.397237 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:40.398757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:40.402291 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:40.418283 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 763/1505] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:40.461566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808fa3-f5ad-41ff-b402-97c846bfb8c8 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:40.461941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808fa3-f5ad-41ff-b402-97c846bfb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:40.462290 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808fa3-f5ad-41ff-b402-97c846bfb8c8 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:40.463726 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 743/1506] 10.222.0.73 () {52 vars in 829 bytes} [Mon Jul 11 14:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:35:40.467574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:40.468917 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:40.568684 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02a118-54e9-451f-8e69-4f35950f0897 service cinder] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:40.661409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:40.662278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:40.662556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:40.662825 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] PATH_INFO: `/v3/users/2618331439be481d8f0c4578b6b893eb` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:40.674826 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2618331439be481d8f0c4578b6b893eb)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:40.675840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:40.675840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:35:40.675840 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:35:40.677065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:40.686937 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:40.740110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2618331439be481d8f0c4578b6b893eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:40.758511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2618331439be481d8f0c4578b6b893eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:40.759058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2618331439be481d8f0c4578b6b893eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:40.771460 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2618331439be481d8f0c4578b6b893eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:40.771899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2618331439be481d8f0c4578b6b893eb'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:40.786080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 764/1507] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Jul 11 14:35:40 2022] DELETE /identity/v3/users/2618331439be481d8f0c4578b6b893eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:35:40.791024 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:40.791526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:40.791622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:40.859289 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:35:40.860425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:40.936086 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:40.954271 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 744/1508] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:35:40.964400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:40.965685 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:41.066676 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a0b0a-403d-4e66-a1e9-4e240295ff24 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:41.121301 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:41.142779 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:41.143432 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:41.143715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:41.143994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:41.145670 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:41.262741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:41.264183 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092e0a3-9249-4b5a-95ff-a0c7323ec16b service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:41.283349 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 765/1509] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:35:41.621886 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:35:41.623158 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:35:41.635675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c91956-c2fa-48d6-9b0a-0deb676cb2ec None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:35:41.740278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:35:41.741177 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:35:41.741466 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:35:41.741741 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] PATH_INFO: `/v3/projects/1b8ef644671943c4b9db4fb470ca8925` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:35:41.752997 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8ef644671943c4b9db4fb470ca8925)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:35:41.754021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:35:41.754021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:35:41.754021 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:35:41.755201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:35:41.812834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8ef644671943c4b9db4fb470ca8925', 'request_id': 'req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:41.826616 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8ef644671943c4b9db4fb470ca8925', 'request_id': 'req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:41.832617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8ef644671943c4b9db4fb470ca8925', 'request_id': 'req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:41.859960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] The token cache is being invalidate because project 1b8ef644671943c4b9db4fb470ca8925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:35:41.860244 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:41.860665 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-d3213e81-0aef-41c7-bdd5-f00e8a155ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:35:41.862145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 745/1510] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Jul 11 14:35:41 2022] DELETE /identity/v3/projects/1b8ef644671943c4b9db4fb470ca8925 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:35:51.281035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=62 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:35:51.857936 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:01.571373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.571965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.571965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.573355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:01.578274 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803fcb7-9329-4aba-8bde-340a28975185 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:01.578734 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803fcb7-9329-4aba-8bde-340a28975185 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:01.578866 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803fcb7-9329-4aba-8bde-340a28975185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:01.658033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-e803fcb7-9329-4aba-8bde-340a28975185 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:01.659264 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-e803fcb7-9329-4aba-8bde-340a28975185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:01.764074 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:01.919693 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:01.921836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:02.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a25285-3c51-4a65-b3ec-63d3e4bcb02e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:02.051096 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:02.051735 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.054564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.054857 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.063373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:02.065016 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495fac-bc70-49b9-ab85-02d7445ef29a service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:02.074288 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 767/1513] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:02.917572 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a57c-67fb-403c-a45a-fac688509dee None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.918110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a57c-67fb-403c-a45a-fac688509dee None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.918110 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a57c-67fb-403c-a45a-fac688509dee None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.919432 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:02.924270 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adfc4-26ea-4eec-a5df-da0a2220d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:02.924710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adfc4-26ea-4eec-a5df-da0a2220d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:02.924823 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adfc4-26ea-4eec-a5df-da0a2220d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:02.943282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-762adfc4-26ea-4eec-a5df-da0a2220d5f6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:02.945101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-762adfc4-26ea-4eec-a5df-da0a2220d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:02.953090 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:03.105145 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a57c-67fb-403c-a45a-fac688509dee None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:03.120797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a57c-67fb-403c-a45a-fac688509dee None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:03.126599 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:03.127279 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:03.127548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:03.127832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:03.137610 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:03.139478 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a251-d2f8-41ce-952a-83aea2883e3f service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:03.149738 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 748/1516] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:05.884816 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238885d-0b6d-4f16-95cf-c1937dd1e7b4 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.885616 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238885d-0b6d-4f16-95cf-c1937dd1e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.885734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238885d-0b6d-4f16-95cf-c1937dd1e7b4 None None] PATH_INFO: `/v3` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:05.887107 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 769/1517] 10.222.0.82 () {54 vars in 925 bytes} [Mon Jul 11 14:37:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:37:05.893732 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919824-114c-4234-993b-f66ba001b6fa None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:05.894173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919824-114c-4234-993b-f66ba001b6fa None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:05.894284 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919824-114c-4234-993b-f66ba001b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:05.954850 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-01919824-114c-4234-993b-f66ba001b6fa None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:05.956045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-01919824-114c-4234-993b-f66ba001b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:05.972953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:06.027965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 749/1518] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Jul 11 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:12.938521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=56 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:14.352906 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e7d6-ede8-4925-9f52-7eba31b15090 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.353556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e7d6-ede8-4925-9f52-7eba31b15090 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.353556 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e7d6-ede8-4925-9f52-7eba31b15090 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.354880 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 770/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:14.359598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1085a-e8c7-4bea-870e-79243c744bd6 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.360029 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1085a-e8c7-4bea-870e-79243c744bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.360186 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1085a-e8c7-4bea-870e-79243c744bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.379493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-19b1085a-e8c7-4bea-870e-79243c744bd6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:14.380710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-19b1085a-e8c7-4bea-870e-79243c744bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:14.389417 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 750/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:14.546292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e7d6-ede8-4925-9f52-7eba31b15090 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:14.561262 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e7d6-ede8-4925-9f52-7eba31b15090 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:14.568133 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:14.569387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.569678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.569983 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.579069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:14.580647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554901d7-7176-42a3-a7fd-a9e93bd30a0a service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:14.591344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 771/1521] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:14.838815 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034021-54ff-4021-aa91-e685732ce4bb None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.839231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034021-54ff-4021-aa91-e685732ce4bb None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.839590 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73034021-54ff-4021-aa91-e685732ce4bb None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.841125 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 751/1522] 10.222.0.73 () {54 vars in 960 bytes} [Mon Jul 11 14:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:14.846216 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd683-dd56-442f-a185-baa380fc21bc None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.846579 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd683-dd56-442f-a185-baa380fc21bc None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.846854 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd683-dd56-442f-a185-baa380fc21bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.864933 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-faefd683-dd56-442f-a185-baa380fc21bc None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:14.866169 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-faefd683-dd56-442f-a185-baa380fc21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:14.874648 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 772/1523] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Jul 11 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:14.883023 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034021-54ff-4021-aa91-e685732ce4bb None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:14.896388 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73034021-54ff-4021-aa91-e685732ce4bb None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:14.901422 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:14.902058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:14.902351 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:14.902629 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:14.912148 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:14.913809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85980f02-33bf-4169-806a-c4f5786db48b service placement] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:14.925199 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 752/1524] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:15.431512 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b17aa-1688-406c-8eda-29fa7853e32c None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.432081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b17aa-1688-406c-8eda-29fa7853e32c None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.432081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b17aa-1688-406c-8eda-29fa7853e32c None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.433539 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:15.438447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf63af-acf5-4d5d-9838-cc8b254762dc None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.438913 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf63af-acf5-4d5d-9838-cc8b254762dc None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.439046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf63af-acf5-4d5d-9838-cc8b254762dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.457144 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-9ebf63af-acf5-4d5d-9838-cc8b254762dc None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:15.458386 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9ebf63af-acf5-4d5d-9838-cc8b254762dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:15.466327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:15.620490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b17aa-1688-406c-8eda-29fa7853e32c None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:15.634972 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b17aa-1688-406c-8eda-29fa7853e32c None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:15.640839 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:15.641521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:15.641797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:15.642071 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:15.651491 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:15.653118 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaabc40-fda4-46d8-bca9-312b1b9dec0f service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:15.664688 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 774/1527] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:19.987039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:19.987597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:19.987597 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:19.989039 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:19.994182 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cfcd-cd81-4f03-9a78-2382487d607f None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:19.994620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cfcd-cd81-4f03-9a78-2382487d607f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:19.994740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cfcd-cd81-4f03-9a78-2382487d607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:20.013004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1113cfcd-cd81-4f03-9a78-2382487d607f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:20.014398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1113cfcd-cd81-4f03-9a78-2382487d607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:20.022815 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:20.098415 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:20.101050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:20.179938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0e3b4-9767-4004-bc59-e5f7bcf4e3b1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:20.183575 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:20.184221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:20.184506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:20.184787 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:20.194713 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:20.196159 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429537d9-f258-4fad-bd59-4cfce4484fe1 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:20.205918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 755/1530] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:22.243229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984de1-4397-418a-a938-c957e04e96c9 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.243797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984de1-4397-418a-a938-c957e04e96c9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.243797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984de1-4397-418a-a938-c957e04e96c9 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.247431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:22.250789 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104fd2f-4f46-4d5d-803c-2cf2622e575f None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.251204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104fd2f-4f46-4d5d-803c-2cf2622e575f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.251345 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104fd2f-4f46-4d5d-803c-2cf2622e575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.270058 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-9104fd2f-4f46-4d5d-803c-2cf2622e575f None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:22.271254 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9104fd2f-4f46-4d5d-803c-2cf2622e575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:22.279285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:22.315636 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984de1-4397-418a-a938-c957e04e96c9 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:22.326387 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd984de1-4397-418a-a938-c957e04e96c9 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:22.329941 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:22.330576 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:22.330866 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:22.331148 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:22.340587 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:22.342066 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50635fbf-7883-41de-b6ff-72432b31adda service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:22.352299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 777/1533] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:26.345729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:26.346308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:26.346308 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:26.347688 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:26.352950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48200a7-04f3-412a-9581-6d5afa0f6e97 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:26.353361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48200a7-04f3-412a-9581-6d5afa0f6e97 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:26.353519 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48200a7-04f3-412a-9581-6d5afa0f6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:26.371822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-c48200a7-04f3-412a-9581-6d5afa0f6e97 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:26.373073 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-c48200a7-04f3-412a-9581-6d5afa0f6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:26.381525 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:26.695925 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:26.697711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:26.762217 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:26.776106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8a93-c4c3-4e5d-9e2b-f61bf3a9632b None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:26.779743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8fddb8437e4b058dc5891c0ef2937b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:26.780392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:26.780703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:26.780996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:26.790730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:26.792157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6789c82-e1a3-46b0-8ec2-ea4e1b419143 service cinder] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:26.802088 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 758/1536] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:28.872447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:28.873004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:28.873004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:28.874474 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:37:28.880278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884ee7-981b-4467-8311-30d4b4e20a9c None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:28.880714 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884ee7-981b-4467-8311-30d4b4e20a9c None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:28.880812 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884ee7-981b-4467-8311-30d4b4e20a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:28.899536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-18884ee7-981b-4467-8311-30d4b4e20a9c None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:37:28.900723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-18884ee7-981b-4467-8311-30d4b4e20a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:28.908622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:37:29.219643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:37:29.221361 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:37:29.234864 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a519-f603-42ab-a4ac-d22def38d816 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:37:29.238351 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f8fddb8437e4b058dc5891c0ef2937b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:37:29.238991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:37:29.239277 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:37:29.239559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:37:29.248573 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:37:29.250039 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cff8f0-232c-409c-b50a-9fd8b0b8d152 service cinder] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:37:29.259423 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 780/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:37:38.894421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=11 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:37:39.255255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=33 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:54.378547 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bfd58-e866-4623-a156-e3041fb8be8a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.379155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bfd58-e866-4623-a156-e3041fb8be8a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.379155 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bfd58-e866-4623-a156-e3041fb8be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.387425 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5a86-0e85-49eb-83cc-0b3a5f865bd6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.387940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5a86-0e85-49eb-83cc-0b3a5f865bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.388051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a5a86-0e85-49eb-83cc-0b3a5f865bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.397506 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-041bfd58-e866-4623-a156-e3041fb8be8a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.398724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-041bfd58-e866-4623-a156-e3041fb8be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.407145 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f93a5a86-0e85-49eb-83cc-0b3a5f865bd6 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.408103 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 760/1540] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:38:54.408333 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f93a5a86-0e85-49eb-83cc-0b3a5f865bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.415272 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.415559 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.415834 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.416179 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 781/1541] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:38:54.424135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.424422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.424697 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.434387 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.435574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.443646 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 761/1542] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:38:54.443992 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.445201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.448049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.454116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 782/1543] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:38:54.457288 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33ca0-f50d-4958-aeef-ba78a7307786 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.457809 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.461998 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.462656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.462938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.463210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.463959 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:38:54.464261 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.465872 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.467725 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828e395-06f7-43f6-8f1b-97dd2731b77d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.473540 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.474210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.474502 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.474785 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.475531 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:38:54.475841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.476927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:38:54.476927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:38:54.476927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:38:54.477808 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.485570 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 762/1544] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:38:54.486941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.496904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 783/1545] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:38:54.497236 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ace980-b194-4b6e-9a3c-b888a032dfbd admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.498974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.502025 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.502681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.502965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.503238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.503924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.504975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:38:54.504975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:38:54.504975 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:38:54.506157 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.509009 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35671-2096-4844-919a-054352a01b12 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.514394 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.515050 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.515340 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.516067 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.516767 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.518710 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.543928 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 763/1546] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:38:54.548588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.553191 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 784/1547] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:38:54.554561 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.611435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287680d-1078-420e-8339-d6e1893d5707 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.616023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759aaa4-769a-4552-877d-730b73a2404c admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.616898 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.617265 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.617566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.617819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.618515 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.620421 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.621789 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.622461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.622749 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.623041 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.623718 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.624759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:38:54.624759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:38:54.624759 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:38:54.625980 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.643197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 764/1548] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:38:54.647037 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.647503 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 785/1549] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:38:54.650998 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.659361 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102852-5290-4eef-a29b-94a0e0fcf72a admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.661135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f61e3-0916-40b2-b73b-cb495e3bebb4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.664062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.664876 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.665204 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.665468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.665940 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.666207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.666595 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.666883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.667160 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.667797 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.667904 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.669509 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.677966 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 765/1550] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:38:54.681397 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 786/1551] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:38:54.682107 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.685081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.691948 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c0c3-e81f-4b4f-9dc9-479e0b0fc71e admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.694555 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641170-c5e8-4694-93e4-bc50e007bbc9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.696584 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.697262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.697550 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.698151 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.698574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.699734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.700185 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.700371 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.700656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.701038 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.701897 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.704185 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.711918 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 766/1552] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:38:54.716050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.721018 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 787/1553] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:38:54.722209 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.726721 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2566e-088c-49e4-a7a6-ae5239178734 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.731627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.732052 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ebcc-1f02-40c1-b1fe-373d2dff4886 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.732668 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.733005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.733287 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] PATH_INFO: `/v3/projects/40c934e5f58b409fa0736555c1002374/users/d349d539a500498892c3ace5f5784f30/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.736756 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.737662 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.737942 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.738220 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] PATH_INFO: `/v3/projects/124a5e18ffef4643b7f4dcf4e7c2431c/users/aedc1b1cfdb0417bb0b6d5320bf9d691/roles/ad3f7de6169e46818a2e6e66d91aacc2` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.748174 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c934e5f58b409fa0736555c1002374, user_id=d349d539a500498892c3ace5f5784f30, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.749396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:38:54.749396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:38:54.749396 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:38:54.751391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab046e0-6c44-4164-a6f8-f938fd02ec25 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.753080 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=124a5e18ffef4643b7f4dcf4e7c2431c, user_id=aedc1b1cfdb0417bb0b6d5320bf9d691, role_id=ad3f7de6169e46818a2e6e66d91aacc2)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.755733 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc127dbc-8489-4943-a2e5-a9f19bc6cd4f admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.765493 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 767/1554] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:38:54 2022] PUT /identity/v3/projects/40c934e5f58b409fa0736555c1002374/users/d349d539a500498892c3ace5f5784f30/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:38:54.769575 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 788/1555] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:38:54 2022] PUT /identity/v3/projects/124a5e18ffef4643b7f4dcf4e7c2431c/users/aedc1b1cfdb0417bb0b6d5320bf9d691/roles/ad3f7de6169e46818a2e6e66d91aacc2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:38:54.770791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.771083 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.771365 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.774354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.774647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.774931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.789482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.790694 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.792727 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] MFA Rules not processed for user `ab535bfd955b40ebbede39640e8b5ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:38:54.794046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.832779 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:54.841528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:38:54.853216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 768/1556] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:38:54.854438 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 789/1557] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:38:54.863450 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.865250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:38:54.866603 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:38:54.920255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c455d4f-e5d8-4b61-8383-45320d7c765a None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.924098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8089f6f-8cf7-487b-a0da-b6d9bad47a1b None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:38:54.924525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.925211 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.925497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.925773 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.927919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:38:54.928810 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:38:54.929123 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:38:54.929400 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:38:54.935286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.937266 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56f72a-0092-4d42-9135-660613fa4e8c service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.939402 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:38:54.940814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:38:54.946804 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 769/1558] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:38:54.950889 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 790/1559] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:39:01.840152 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:01.840528 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:01.840729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:01.884123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] MFA Rules not processed for user `d349d539a500498892c3ace5f5784f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:01.885755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:02.026163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 770/1560] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:02.030552 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.042285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702b465-cbbe-416f-9d12-444d6f647c70 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.081548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.082537 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.083058 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.083682 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] PATH_INFO: `/v3/projects` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.084774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.086947 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.136563 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.136993 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 791/1561] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:39:02.149705 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62862c8-3d31-42ec-882f-62dd8a4f3cfc None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.266772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.267903 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.268200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.268470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.271109 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.275362 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.314521 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 771/1562] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:39:02.316046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.334350 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf00a4a-8917-4c6a-b591-4903e3fc608e admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.354872 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.355583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.355874 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.356331 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.357267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.359621 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.371211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 792/1563] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:39:02.376080 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.392470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a8b06-6d8e-4432-b6e0-899082ba6e9b admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.405333 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.406407 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.406625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.407106 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] PATH_INFO: `/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d/users/ac1d6d285fe64012a8284d9220a59297/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.416309 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:02.439642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c8e8b14f7d4465af6d336ebc9e071d, user_id=ac1d6d285fe64012a8284d9220a59297, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.442686 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.465663 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 772/1564] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:39:02 2022] PUT /identity/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d/users/ac1d6d285fe64012a8284d9220a59297/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:02.468111 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.484893 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984043dd-710c-4423-be4c-099b733724b0 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.575687 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.576520 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.577046 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.577420 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.578268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.579985 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b7af3-b468-498f-a62e-09ec3ce73442 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.600740 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 793/1565] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:39:02.605964 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.607330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.607632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.607927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.617525 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942da927-5675-498c-b68c-d38603b56e5c admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.622774 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.623358 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.623729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.623950 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] PATH_INFO: `/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d/users/ac1d6d285fe64012a8284d9220a59297/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.626598 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c8e8b14f7d4465af6d336ebc9e071d, user_id=ac1d6d285fe64012a8284d9220a59297, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.629533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.647840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 773/1566] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:39:02 2022] PUT /identity/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d/users/ac1d6d285fe64012a8284d9220a59297/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:02.649855 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:02.651276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:02.737760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:02.768484 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 794/1567] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:39:02.773122 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.894353 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d3a61-a091-488e-ac98-8f0371e3fed5 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:02.899932 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:02.900935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:02.901322 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:02.901718 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:02.902880 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:02.907656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:02.952346 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 774/1568] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:39:02.954342 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:02.977417 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22cc2-9424-467d-9109-e90db3a1a598 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.061487 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.062321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.062700 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.063069 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.063899 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.065970 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.109886 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 795/1569] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Jul 11 14:39:02 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:39:03.110479 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:03.125558 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6476-5743-4cf6-8dba-f5cc89c5b8a0 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.135124 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.135921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.136476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.136758 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.137625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.139762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.163775 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 775/1570] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:39:03.165007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:03.180271 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629727c-ace9-4783-9f5f-555ff07cfaf9 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.190081 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.191180 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.191628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.191995 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] PATH_INFO: `/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320/users/729674baac454e5eb85c5c3e9fecaf6b/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.231257 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b26ed3e3d34aa8a6078bcae00f5320, user_id=729674baac454e5eb85c5c3e9fecaf6b, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.235282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.273963 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 796/1571] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:39:03 2022] PUT /identity/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320/users/729674baac454e5eb85c5c3e9fecaf6b/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:03.278430 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:03.290976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cad02c-99e1-4e1d-8747-7e7e1bbb268a admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.374943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.376008 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.376626 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.377138 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.378123 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.380459 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7528622-caee-490d-b882-7ced16de99a0 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.394735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 776/1572] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Jul 11 14:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:39:03.398973 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:03.413705 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b780aa-f67d-455c-8e1f-b2712aa02d50 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:03.425530 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:03.427210 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:03.427741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:03.428241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] PATH_INFO: `/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320/users/729674baac454e5eb85c5c3e9fecaf6b/roles/b513ad68ac0842deaa147cad48f0dd76` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:03.432134 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b26ed3e3d34aa8a6078bcae00f5320, user_id=729674baac454e5eb85c5c3e9fecaf6b, role_id=b513ad68ac0842deaa147cad48f0dd76)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:03.439861 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:03.474386 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 797/1573] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Jul 11 14:39:03 2022] PUT /identity/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320/users/729674baac454e5eb85c5c3e9fecaf6b/roles/b513ad68ac0842deaa147cad48f0dd76 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:39:08.741454 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472018d-6ae5-4f9f-9724-c47f9e44225a None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:08.741870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472018d-6ae5-4f9f-9724-c47f9e44225a None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:08.742299 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472018d-6ae5-4f9f-9724-c47f9e44225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:08.793924 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-1472018d-6ae5-4f9f-9724-c47f9e44225a None None] MFA Rules not processed for user `ac1d6d285fe64012a8284d9220a59297`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:08.795201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-1472018d-6ae5-4f9f-9724-c47f9e44225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:08.862645 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:08.974247 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 777/1574] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:39:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:08.987362 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:08.989229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.141155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65737ee-a54f-4907-b6e4-7434d560eff4 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:09.147882 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d3b61b59d4208be7396a153d6231e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:09.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.149344 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.149975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.210541 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:09.264548 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:09.266140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417a211-4f86-4e3b-b1e5-321970cc33d0 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:09.280284 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 798/1575] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:09.344802 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.345128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.345498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.405855 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] MFA Rules not processed for user `729674baac454e5eb85c5c3e9fecaf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:09.407223 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.499741 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.500045 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.500325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.529001 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 778/1576] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:09.542180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:09.553826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d3d86-4815-4acd-a09f-8618bea80164 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:09.558910 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d3b61b59d4208be7396a153d6231e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:09.559355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.559710 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.560065 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.565222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:09.566859 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.645490 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 799/1577] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:39:09.646980 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:09.648453 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a8e8c-2cc7-4d3d-8a36-05f946e15440 service glance] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:09.661622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 779/1578] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:39:09.745620 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:09.747310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:09.866094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a6b58-64d1-495b-8290-30a3a787209d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:09.872891 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:09.874065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:09.874065 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:09.874256 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:09.883404 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:09.885409 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:09.900251 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 800/1579] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:39:11.448076 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72818-4ead-473c-9d88-e1459e45d678 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:11.450139 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72818-4ead-473c-9d88-e1459e45d678 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:11.450911 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e72818-4ead-473c-9d88-e1459e45d678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:11.491729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-07e72818-4ead-473c-9d88-e1459e45d678 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:11.493618 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-07e72818-4ead-473c-9d88-e1459e45d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:11.514832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 780/1580] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:11.553476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:11.577343 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3ade-7f0f-47f0-bd3f-8f983ea28f63 service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:11.590045 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:11.591091 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:11.591602 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:11.592617 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:11.608222 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:11.609871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936ca0-b4ce-43b2-8ca6-1d5007b0e9f7 service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:11.628229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 801/1581] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:39:21.175502 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5f18-e33b-4c11-913a-3edc4971719d None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.176050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5f18-e33b-4c11-913a-3edc4971719d None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.176050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d5f18-e33b-4c11-913a-3edc4971719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.194548 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-063d5f18-e33b-4c11-913a-3edc4971719d None None] MFA Rules not processed for user `d349d539a500498892c3ace5f5784f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:21.195743 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-063d5f18-e33b-4c11-913a-3edc4971719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:21.203192 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 781/1582] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:21.494883 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434805-d040-4774-bee3-32d36dc71c75 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.495472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434805-d040-4774-bee3-32d36dc71c75 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.495472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19434805-d040-4774-bee3-32d36dc71c75 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.497534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 802/1583] 10.222.0.73 () {54 vars in 961 bytes} [Mon Jul 11 14:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:21.507684 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2aee3-a897-4992-9521-966bd3c89e63 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.507977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2aee3-a897-4992-9521-966bd3c89e63 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.508257 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2aee3-a897-4992-9521-966bd3c89e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.545541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-67f2aee3-a897-4992-9521-966bd3c89e63 None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:21.546785 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-67f2aee3-a897-4992-9521-966bd3c89e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:21.566762 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=100 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:21.614840 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 782/1584] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Jul 11 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:21.615841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=97 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:21.620268 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.620565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.620842 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.622246 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 803/1585] 10.222.0.73 () {54 vars in 912 bytes} [Mon Jul 11 14:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:21.627861 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632e9-4af5-4b3f-aa7c-a53f807b4033 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.628153 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632e9-4af5-4b3f-aa7c-a53f807b4033 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.628434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0632e9-4af5-4b3f-aa7c-a53f807b4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.647332 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-9b0632e9-4af5-4b3f-aa7c-a53f807b4033 None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:21.648533 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-9b0632e9-4af5-4b3f-aa7c-a53f807b4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:21.657977 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 783/1586] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:39:21.670229 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:21.672138 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:21.686788 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c91e95-bc51-445f-9ca2-e07ee328d092 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:21.690534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992d3b61b59d4208be7396a153d6231e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:21.691136 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:21.691433 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:21.691715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:21.703245 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:21.704663 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f6b46-c3de-424d-874a-31b813334162 service glance] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:21.715526 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 804/1587] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:22.195183 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622ed3-9680-4639-a47a-bf7f3bc78a83 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.195707 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622ed3-9680-4639-a47a-bf7f3bc78a83 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.195801 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d622ed3-9680-4639-a47a-bf7f3bc78a83 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.197160 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 784/1588] 10.222.0.73 () {54 vars in 912 bytes} [Mon Jul 11 14:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:22.202369 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60a92-a83d-4e3a-9f04-56d80c1d02e0 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.202656 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60a92-a83d-4e3a-9f04-56d80c1d02e0 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.202939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60a92-a83d-4e3a-9f04-56d80c1d02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.239303 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5db60a92-a83d-4e3a-9f04-56d80c1d02e0 None None] MFA Rules not processed for user `36fa4087f9e348ea87a4d918a23b5660`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:22.240671 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5db60a92-a83d-4e3a-9f04-56d80c1d02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:22.292428 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 805/1589] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:22.304216 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d622ed3-9680-4639-a47a-bf7f3bc78a83 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:22.315221 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d622ed3-9680-4639-a47a-bf7f3bc78a83 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:22.318711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:22.319360 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.319649 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.319934 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.328656 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:22.330210 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5c58-808a-4211-827f-44a9ae282e56 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:22.338082 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 785/1590] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:22.735525 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29039a8-5cfb-4af5-888b-9f6d49cf7a43 None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.736036 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29039a8-5cfb-4af5-888b-9f6d49cf7a43 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.736461 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29039a8-5cfb-4af5-888b-9f6d49cf7a43 None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.738218 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 806/1591] 10.222.0.73 () {54 vars in 961 bytes} [Mon Jul 11 14:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:22.744173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ab97-35d6-4e22-abad-c504a30d8fc1 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.744483 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ab97-35d6-4e22-abad-c504a30d8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.744805 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192ab97-35d6-4e22-abad-c504a30d8fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.753794 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6f95-f87b-41e2-a966-8eeb5929415d None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.754077 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6f95-f87b-41e2-a966-8eeb5929415d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.754355 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6f95-f87b-41e2-a966-8eeb5929415d None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.755782 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 807/1592] 10.222.0.73 () {54 vars in 960 bytes} [Mon Jul 11 14:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:39:22.761395 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.761679 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.761956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.766320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-c192ab97-35d6-4e22-abad-c504a30d8fc1 None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:22.767472 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-c192ab97-35d6-4e22-abad-c504a30d8fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:22.776921 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 786/1593] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Jul 11 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:22.781267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:22.782539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72003de7-7c1a-4a5e-99ec-f41788459773 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.782647 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:22.782827 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72003de7-7c1a-4a5e-99ec-f41788459773 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.783101 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72003de7-7c1a-4a5e-99ec-f41788459773 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.784406 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 787/1594] 10.222.0.73 () {54 vars in 912 bytes} [Mon Jul 11 14:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:39:22.789267 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.789632 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.789919 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.809062 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:22.810974 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:22.821892 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 788/1595] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:39:22.835180 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:22.844231 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fb978-5414-427a-9412-eb86c2dcb8fd None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:22.847941 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:22.848580 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.848882 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.849166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.853476 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 808/1596] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Jul 11 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:39:22.859667 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:22.861213 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3ac81-84d1-4c38-9502-20c9ef83fe05 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:22.861326 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:22.871274 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c317e-93b5-4c7b-9b1c-51ccca2626bf None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:22.872128 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 789/1597] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:39:22.877191 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:22.877848 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:22.878119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:22.878390 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:22.880161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:22.892542 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:22.894217 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:22.904529 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 809/1598] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:39:24.686276 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde4dde-8a86-4dc0-ba8c-b971d66156ac None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:24.686761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde4dde-8a86-4dc0-ba8c-b971d66156ac None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:24.686856 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde4dde-8a86-4dc0-ba8c-b971d66156ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:24.704379 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-dcde4dde-8a86-4dc0-ba8c-b971d66156ac None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:24.705612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-dcde4dde-8a86-4dc0-ba8c-b971d66156ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:24.714100 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 790/1599] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:24.731215 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:24.747652 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af49033-e089-40ca-a0d4-6b36c98ccfac service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:24.754057 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:24.754807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:24.755161 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:24.755501 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:24.766278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:24.768007 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:24.780485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 810/1600] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:39:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:39:34.699133 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=44 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:34.775200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=76 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:39:41.295234 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e988c3-cf61-4105-91c9-070f8d729790 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:41.295806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e988c3-cf61-4105-91c9-070f8d729790 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:41.295806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e988c3-cf61-4105-91c9-070f8d729790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:41.316729 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-a4e988c3-cf61-4105-91c9-070f8d729790 None None] MFA Rules not processed for user `36fa4087f9e348ea87a4d918a23b5660`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:41.317981 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a4e988c3-cf61-4105-91c9-070f8d729790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:41.324955 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 791/1601] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Jul 11 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:41.336606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:41.345651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97534-0a59-4cdf-a79a-0439b6249bad service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:41.349195 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:41.349832 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:41.350117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:41.350393 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:41.358105 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:41.359528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49248086-99d1-48f7-8a5b-36febc2d0921 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:41.367348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 811/1602] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:42.123131 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1053-4c9e-4fdf-9d9d-f51bffcd8c7f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:42.123536 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1053-4c9e-4fdf-9d9d-f51bffcd8c7f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:42.123917 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1053-4c9e-4fdf-9d9d-f51bffcd8c7f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:42.126286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 792/1603] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:42.132023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b30d-55ce-4d72-90df-d5c2936127e3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:42.132559 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b30d-55ce-4d72-90df-d5c2936127e3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:42.132921 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b30d-55ce-4d72-90df-d5c2936127e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:42.161500 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-9bc0b30d-55ce-4d72-90df-d5c2936127e3 None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:42.162738 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-9bc0b30d-55ce-4d72-90df-d5c2936127e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:42.172322 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 812/1604] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:42.229149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1053-4c9e-4fdf-9d9d-f51bffcd8c7f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:42.244942 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1053-4c9e-4fdf-9d9d-f51bffcd8c7f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:42.251005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:42.251659 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:42.252002 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:42.252214 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:42.261806 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:42.263475 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19361f3d-4433-4a78-b3b1-b91e3392300f service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:42.274878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 793/1605] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:39:50.505429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6e8e-2016-41f6-bb07-cc80c856a81f None None] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:50.506029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6e8e-2016-41f6-bb07-cc80c856a81f None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:50.506029 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6e8e-2016-41f6-bb07-cc80c856a81f None None] PATH_INFO: `/` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:50.507373 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 813/1606] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:39:50.517328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827212b8-a89b-489f-a27e-81e98cbb7f1e None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:50.517945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827212b8-a89b-489f-a27e-81e98cbb7f1e None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:50.517945 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827212b8-a89b-489f-a27e-81e98cbb7f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:50.536946 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-827212b8-a89b-489f-a27e-81e98cbb7f1e None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:39:50.538171 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-827212b8-a89b-489f-a27e-81e98cbb7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:39:50.547428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 794/1607] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:39:50.562106 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6e8e-2016-41f6-bb07-cc80c856a81f None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:39:50.578241 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6e8e-2016-41f6-bb07-cc80c856a81f None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:39:50.584070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:39:50.584822 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:39:50.585269 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:39:50.585618 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:39:50.595337 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:39:50.596956 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693aa8-9edd-4241-a72a-9e2f71b0f34e service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:39:50.607565 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 814/1608] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:40:00.531953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=12 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:00.603157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:08.093419 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:08.093938 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:08.094050 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:08.111730 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:08.112982 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:08.121410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 795/1609] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:08.449801 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:08.450278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:08.450959 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:08.472192 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] MFA Rules not processed for user `36fa4087f9e348ea87a4d918a23b5660`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:08.473419 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:08.480444 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 815/1610] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:08.491595 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:08.501987 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefde4-a0a0-479c-aa26-200278496fdd None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:08.505530 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:08.506163 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:08.506447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:08.506723 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:08.513933 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:08.515350 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e88476-b8d5-43d3-9f62-fe8ebc6f7d65 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:08.522995 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 796/1611] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:16.415699 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:16.425286 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037fae-b86b-4a9a-9203-e101371ed17e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:16.429588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:16.430248 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:16.430564 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:16.430841 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:16.440413 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:16.442026 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243189-7a2b-47ee-8d30-77666edff2cf service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:16.464102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 816/1612] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:16.518046 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6fce-fb7d-4279-be9c-43665aaf98a2 None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:16.518553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6fce-fb7d-4279-be9c-43665aaf98a2 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:16.518647 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6fce-fb7d-4279-be9c-43665aaf98a2 None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:16.521069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 797/1613] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:40:16.543119 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c6b9-83af-4d08-bca4-7e82489d6427 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:16.543631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c6b9-83af-4d08-bca4-7e82489d6427 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:16.543929 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c6b9-83af-4d08-bca4-7e82489d6427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:16.567143 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5dd3c6b9-83af-4d08-bca4-7e82489d6427 None None] MFA Rules not processed for user `861c2da914694e319257102a0fd2f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:40:16.568532 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5dd3c6b9-83af-4d08-bca4-7e82489d6427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:40:16.579528 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 817/1614] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:40:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:40:16.616473 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6fce-fb7d-4279-be9c-43665aaf98a2 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:40:16.635628 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6fce-fb7d-4279-be9c-43665aaf98a2 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:40:16.643566 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:40:16.644642 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:40:16.645278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:40:16.645869 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:40:16.659471 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:40:16.661392 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bde26-6947-46f2-8105-dcc5210e8c17 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:40:16.677844 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 798/1615] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:40:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:40:26.560715 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=12 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:40:26.669586 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=15 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:08.949511 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:08.950051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:08.950051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:08.967689 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:08.968919 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:08.975757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 818/1616] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:18.962084 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:26.899095 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868d30-c3d3-4a68-8de3-643ab11a05a8 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.899576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868d30-c3d3-4a68-8de3-643ab11a05a8 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.899673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868d30-c3d3-4a68-8de3-643ab11a05a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.917016 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-12868d30-c3d3-4a68-8de3-643ab11a05a8 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:26.918197 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-12868d30-c3d3-4a68-8de3-643ab11a05a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:26.925262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 799/1617] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:26.968601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:41:26.980321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a4354-ac04-4b4b-896d-4dd5abe97191 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:41:26.985305 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:41:26.985945 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:26.986258 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:26.986534 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:26.994574 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:41:26.996100 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e0851-132d-41a1-9375-5d822ea4f13d service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:41:27.004650 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 819/1618] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:41:32.394899 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:41:32.395382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:41:32.395476 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:41:32.413260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:41:32.414448 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:41:32.421341 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 800/1619] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:41:37.001436 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:41:42.408173 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=6 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:05.336377 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468def0-2adb-4a41-b4eb-cba56544fe50 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.336975 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468def0-2adb-4a41-b4eb-cba56544fe50 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.337078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468def0-2adb-4a41-b4eb-cba56544fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.354986 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-d468def0-2adb-4a41-b4eb-cba56544fe50 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:05.356774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-d468def0-2adb-4a41-b4eb-cba56544fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:05.364051 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 820/1620] 10.222.0.73 () {58 vars in 967 bytes} [Mon Jul 11 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:05.377414 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:05.389989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2170-916c-4424-a159-2e63f9926f10 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:05.395070 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:05.395717 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:05.396006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:05.396285 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:05.405043 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:05.406630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:05.414672 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 801/1621] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:42:15.349961 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:15.411577 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=6 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:28.251267 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:28.252314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:28.252421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:28.270327 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:42:28.271533 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:42:28.278376 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 821/1622] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:42:29.487206 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:29.498327 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e78a-2702-4032-9ee7-07254fb74aba service swift] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:29.503294 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:29.503930 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:29.504218 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:29.504497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:29.512996 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:29.514565 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:29.524589 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 802/1623] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:38.264672 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=3 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:39.520612 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=6 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:42:44.356765 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:42:44.366849 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3804f-81f0-44b2-bd91-31c39f4e6ab3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:42:44.370353 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:42:44.370994 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:42:44.371278 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:42:44.371577 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:42:44.381690 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:42:44.383103 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:42:44.392431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 822/1624] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:42:54.388319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=6 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:44:36.207089 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:36.219384 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eacf4b-3f15-4822-8640-c8dca08bf603 service placement] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:36.225033 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:36.225675 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:36.225965 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:36.226248 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:36.234084 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:36.235653 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:36.244943 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 803/1625] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:36.328651 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:36.336962 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d546-7d2a-4261-9eed-37b6a3e35bda service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:36.340515 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:36.341178 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:36.341466 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:36.341745 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:36.351518 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:36.352988 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd9ce-ecb5-4e30-a037-9376b28c458a service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:36.363447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 823/1626] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:44:41.943300 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:41.952825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226a563-618c-4768-a86c-30a7e0d9466d service nova] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:41.956369 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:41.957032 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:41.957321 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:41.957602 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:41.968169 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:41.969620 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:41.980750 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 804/1627] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:44.355292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fd19-c2f2-46d3-9b0a-6241314a08e6 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:44.355748 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fd19-c2f2-46d3-9b0a-6241314a08e6 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:44.356415 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868fd19-c2f2-46d3-9b0a-6241314a08e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:44.374282 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-e868fd19-c2f2-46d3-9b0a-6241314a08e6 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:44.375485 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-e868fd19-c2f2-46d3-9b0a-6241314a08e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:44.383201 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 824/1628] 10.222.0.73 () {58 vars in 967 bytes} [Mon Jul 11 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:44.428576 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:44.440297 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec45adc-bf17-4e28-bf2d-39c94a0ead1f service neutron] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:44.445389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:44.446026 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:44.446311 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:44.446617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:44.454651 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:44.456246 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:44.464553 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 805/1629] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:44:44.891871 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97929-722d-4359-9ac7-99b042ac67c9 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:44.892168 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97929-722d-4359-9ac7-99b042ac67c9 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:44.892458 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97929-722d-4359-9ac7-99b042ac67c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:44.910410 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-75d97929-722d-4359-9ac7-99b042ac67c9 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:44.911614 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-75d97929-722d-4359-9ac7-99b042ac67c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:44.919435 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 825/1630] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:44.931368 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:44.941677 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2655d-304e-4ddd-8d07-093c0c29e6c8 service swift] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:44.946704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:44.947337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:44.947622 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:44.947900 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:44.955749 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:44.957337 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:44.965953 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 806/1631] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:44:53.157536 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:53.158023 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:53.158110 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:53.175034 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] MFA Rules not processed for user `d349d539a500498892c3ace5f5784f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:53.176150 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:53.183439 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 826/1632] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:53.434594 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:53.443617 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a2798-012c-46b4-8e60-cbff65fcfa0f service swift] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:53.447286 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:53.447922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:53.448212 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:53.448491 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:53.455519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:53.456976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b17e9-0c0a-48df-9621-ebd26531047e service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:53.464841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 807/1633] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:53.966298 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:53.979035 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f28623-33a4-4872-ac3d-dc8307d8545e None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:53.984115 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:53.984901 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:53.985197 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:53.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:53.994974 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:53.996140 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:54.012984 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 827/1634] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:44:55.214967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] REQUEST_METHOD: `POST` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:55.215434 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:55.215809 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:55.234344 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.auth.core [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:44:55.235898 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:44:55.247893 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 808/1635] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Jul 11 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:44:55.260583 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:44:55.272008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e706a-e70e-4ae2-8461-086cf9874985 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:44:55.277212 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:44:55.277867 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:44:55.278157 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:44:55.278442 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:44:55.287102 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:44:55.288692 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:44:55.297167 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 828/1636] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:45:01.900825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:01.908526 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=34 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:01.927989 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c5804-2384-4486-bcbd-c015a5a2d9d1 None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:01.941997 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:01.942671 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:01.942960 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:01.943238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:01.953485 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:01.955352 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:01.966247 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 809/1637] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:05.293834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=27 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:06.613310 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:06.625527 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d2d42-40d6-47b6-9393-4791d3fd7aca service swift] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:06.629422 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:06.630061 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:06.630348 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:06.630631 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:06.638330 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:06.639736 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e2926-037f-49bf-a53d-7ea786c3db02 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:06.647514 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 829/1638] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:09.564461 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:09.579463 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff83d-dc71-4c17-b470-4c3c03142362 service nova] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:09.587170 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:09.587735 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:09.588022 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:09.588296 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:09.598278 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:09.599935 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:09.612045 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 810/1639] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:12.580385 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:12.580833 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:12.580991 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:12.605605 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:45:12.607696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:45:12.616300 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 830/1640] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:45:13.001724 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:13.010968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aed88d-955a-40c3-a3fb-2a2a78d67ed7 service nova] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:13.014751 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:13.015382 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:13.015661 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:13.015936 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:13.022867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:13.024304 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:13.031849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 811/1641] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:14.318667 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:14.333881 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49df6-cb68-4d8b-b23c-2bc101d56b56 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:14.339244 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:14.339890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:14.340173 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:14.340448 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:14.349339 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:14.350908 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df9e1f-6c64-4b1c-a51f-2f57aa0c4bf2 service nova] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:14.361777 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 831/1642] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:23.028560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=17 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:24.357447 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:45:27.838078 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:45:27.846316 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9faf29-8c8d-48d9-9fea-f96c2f569843 service neutron] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:45:27.849878 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:45:27.850507 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:45:27.850791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:45:27.851064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:45:27.860241 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:45:27.861681 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:45:27.871495 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 812/1643] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:45:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:45:37.866763 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=6 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:34.433915 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:34.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:34.434449 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:34.463153 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] MFA Rules not processed for user `aedc1b1cfdb0417bb0b6d5320bf9d691`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:34.464354 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:34.488000 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 832/1644] 10.222.0.73 () {58 vars in 957 bytes} [Mon Jul 11 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:35.667703 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:35.725135 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0248c-1ee1-4f92-bc6f-508976651c55 service neutron] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:35.730848 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:35.731489 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:35.731790 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:35.732066 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:35.733968 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:35.758574 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:35.760132 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:35.769615 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 813/1645] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:44.485930 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=15 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:45.765704 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=32 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:47:54.610414 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:54.612004 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:54.646965 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59e301-f86a-415f-a341-122ab68d6cd3 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:54.651302 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:54.651950 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:54.652236 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:54.652517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:54.661341 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:54.662760 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594f2e-5671-40bd-8de0-83bef2c40dce service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:54.672591 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 833/1646] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:56.293484 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:56.321914 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f2d8-61bd-4794-8602-d693ec061f88 service placement] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:56.327363 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861c2da914694e319257102a0fd2f19f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:56.328003 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:56.328283 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:56.328739 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:56.337480 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:56.339049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:56.349498 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 814/1647] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:47:58.150012 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.150426 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.150560 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.177421 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] MFA Rules not processed for user `22a8f4b7fb6e4783aac4f34e57ec19fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:47:58.178599 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:47:58.185664 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 834/1648] 10.222.0.73 () {58 vars in 967 bytes} [Mon Jul 11 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:47:58.226064 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.237711 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0537-94ad-4057-857b-a8b6b2617327 service nova] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.242625 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810cd1c21e2d4f379b02b91885be1882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.243269 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.243560 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.243838 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.252541 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.254181 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f967189-c5a9-4be5-afaf-87af54c96e96 service swift] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.262425 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 815/1649] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Jul 11 14:47:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:47:58.616949 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:47:58.626405 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8731d2-2e68-48b3-ad6e-30f7cc729881 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:47:58.629948 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:47:58.630588 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:47:58.630876 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:47:58.631155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:47:58.700918 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:47:58.702359 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f762327-0e5f-4b52-9e65-b7ddb71e54d5 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:47:58.720927 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 835/1650] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:01.905870 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8b0-5d02-4a03-bc9b-d8e4eb5c04ef None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.906397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8b0-5d02-4a03-bc9b-d8e4eb5c04ef None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.906397 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a8b0-5d02-4a03-bc9b-d8e4eb5c04ef None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.908069 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 816/1651] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:48:01.917711 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:01.918116 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:01.918243 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:01.979399 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:48:01.980628 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:01.998834 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 836/1652] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:48:02.012841 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a8b0-5d02-4a03-bc9b-d8e4eb5c04ef None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:02.029431 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a8b0-5d02-4a03-bc9b-d8e4eb5c04ef None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:02.034593 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:02.035482 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:02.035867 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:02.036262 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:02.045470 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:02.047143 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:02.057709 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 817/1653] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:48:05.121521 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:05.133714 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0602104-58a9-4014-a37d-7113e8d0768d None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:05.140312 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:05.141319 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:05.141675 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:05.142019 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] PATH_INFO: `/v3/users/d349d539a500498892c3ace5f5784f30` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:05.143314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d349d539a500498892c3ace5f5784f30)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:05.145429 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:05.193101 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd349d539a500498892c3ace5f5784f30'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.198644 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:05.206211 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd349d539a500498892c3ace5f5784f30'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.206901 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd349d539a500498892c3ace5f5784f30'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.214070 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd349d539a500498892c3ace5f5784f30'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.214698 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd349d539a500498892c3ace5f5784f30'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.227299 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 837/1654] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:05 2022] DELETE /identity/v3/users/d349d539a500498892c3ace5f5784f30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:05.400588 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:05.411435 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b7f6a-a394-42f0-9cfb-0fd24bb667b0 service placement] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:05.467791 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:05.468658 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:05.468976 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:05.469255 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] PATH_INFO: `/v3/projects/40c934e5f58b409fa0736555c1002374` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:05.470447 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c934e5f58b409fa0736555c1002374)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:05.472411 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:05.522238 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c934e5f58b409fa0736555c1002374', 'request_id': 'req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.528207 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c934e5f58b409fa0736555c1002374', 'request_id': 'req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.533571 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c934e5f58b409fa0736555c1002374', 'request_id': 'req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.557320 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] The token cache is being invalidate because project 40c934e5f58b409fa0736555c1002374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:05.557604 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.558224 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.559757 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 818/1655] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:05 2022] DELETE /identity/v3/projects/40c934e5f58b409fa0736555c1002374 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:05.563811 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:05.565292 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:05.578635 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d942be-74e5-40c6-94c9-3e64dd6129d2 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:05.635431 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:05.636314 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:05.636601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:05.636907 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] PATH_INFO: `/v3/users/ac1d6d285fe64012a8284d9220a59297` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:05.638089 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1d6d285fe64012a8284d9220a59297)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:05.639999 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:05.684696 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1d6d285fe64012a8284d9220a59297'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.696205 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1d6d285fe64012a8284d9220a59297'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.697446 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1d6d285fe64012a8284d9220a59297'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.704171 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1d6d285fe64012a8284d9220a59297'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.704807 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1d6d285fe64012a8284d9220a59297'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:05.717504 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 838/1656] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Jul 11 14:48:05 2022] DELETE /identity/v3/users/ac1d6d285fe64012a8284d9220a59297 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:05.899275 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:48:05.900755 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:48:05.914259 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18bf2-53b9-4500-8ff0-a82b4f9dac0d admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:48:05.936258 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:05.973761 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:48:05.974627 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:48:05.975149 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:48:05.975260 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] PATH_INFO: `/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:48:05.976355 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c8e8b14f7d4465af6d336ebc9e071d)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:48:05.978808 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:48:06.023744 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c8e8b14f7d4465af6d336ebc9e071d', 'request_id': 'req-a4793d94-c363-4d7d-b19f-23561f3608a2'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:06.029674 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c8e8b14f7d4465af6d336ebc9e071d', 'request_id': 'req-a4793d94-c363-4d7d-b19f-23561f3608a2'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:06.035126 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c8e8b14f7d4465af6d336ebc9e071d', 'request_id': 'req-a4793d94-c363-4d7d-b19f-23561f3608a2'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:06.047529 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] The token cache is being invalidate because project 29c8e8b14f7d4465af6d336ebc9e071d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:48:06.047819 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:06.048445 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:48:06.050006 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 819/1657] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Jul 11 14:48:05 2022] DELETE /identity/v3/projects/29c8e8b14f7d4465af6d336ebc9e071d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:48:15.713887 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:48:16.044391 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:47.057831 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:47.059964 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:47.118307 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1230b23-c7c9-4073-b8c4-7c78062c7b0a admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:47.167482 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:47.168649 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:47.168971 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:47.169255 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:47.171098 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:47.254806 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:47.256204 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:47.267643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 839/1658] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:48.446826 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:48.448319 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:48.460460 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793d94-c363-4d7d-b19f-23561f3608a2 admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:48.464005 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:48.464673 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:48.464985 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:48.465263 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:48.466970 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:48.479992 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:48.481958 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850a553-f9a9-4c66-bf44-1acedc8e1d64 service neutron] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:48.492539 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 820/1659] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:49:57.262497 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=79 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:58.487849 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=6 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:49:59.580684 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:49:59.582156 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:59.592606 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138bfb7-887d-4d06-bddb-c496e9757819 service neutron] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:49:59.596790 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fa4087f9e348ea87a4d918a23b5660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:49:59.597462 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:49:59.597751 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:49:59.598033 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:49:59.599757 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:49:59.661836 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:49:59.663200 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb47e7-20c6-4d70-a975-ffce91272598 service neutron] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:49:59.672632 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 840/1660] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:50:05.754117 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5991-f087-4953-934c-6fa93f97197f None None] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.754863 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5991-f087-4953-934c-6fa93f97197f None None] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.754951 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5991-f087-4953-934c-6fa93f97197f None None] PATH_INFO: `/` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.756468 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 821/1661] 10.222.0.73 () {54 vars in 921 bytes} [Mon Jul 11 14:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:50:05.765611 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] REQUEST_METHOD: `POST` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.766049 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.766313 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.785870 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.auth.core [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] MFA Rules not processed for user `de41fb2b889b4847bfecbe6ea7585803`. Rule list: `[]` (Enabled: `True`). {{(pid=80385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:50:05.787094 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.840519 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5991-f087-4953-934c-6fa93f97197f None None] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.842303 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-034f5991-f087-4953-934c-6fa93f97197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.857967 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5991-f087-4953-934c-6fa93f97197f None None] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.858135 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 841/1662] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Jul 11 14:50:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:50:05.863201 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.864373 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.864497 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.864725 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] PATH_INFO: `/v3/users/aedc1b1cfdb0417bb0b6d5320bf9d691` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.870774 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:05.872250 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:05.880075 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aedc1b1cfdb0417bb0b6d5320bf9d691)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.881203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: WARNING py.warnings [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:50:05.881203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: warnings.warn(msg) Jul 11 14:50:05.881203 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: Jul 11 14:50:05.882410 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.886321 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2d2e-d19b-4dff-af33-8af8409c5448 None None] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:05.891323 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:05.891967 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] REQUEST_METHOD: `GET` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:05.892285 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:05.892568 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:05.901369 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:05.902939 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:05.912678 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 842/1663] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:50:05.950897 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aedc1b1cfdb0417bb0b6d5320bf9d691'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.968868 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aedc1b1cfdb0417bb0b6d5320bf9d691'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.969561 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aedc1b1cfdb0417bb0b6d5320bf9d691'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.977094 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aedc1b1cfdb0417bb0b6d5320bf9d691'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.977728 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aedc1b1cfdb0417bb0b6d5320bf9d691'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:05.994655 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 822/1664] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:05 2022] DELETE /identity/v3/users/aedc1b1cfdb0417bb0b6d5320bf9d691 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:06.166608 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.179325 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d1dc-9eea-4f80-9673-522ee5dac2f4 service placement] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.235643 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.237142 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.237437 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.237743 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] PATH_INFO: `/v3/projects/124a5e18ffef4643b7f4dcf4e7c2431c` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.247835 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124a5e18ffef4643b7f4dcf4e7c2431c)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.248890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: WARNING py.warnings [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:50:06.248890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: warnings.warn(msg) Jul 11 14:50:06.248890 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: Jul 11 14:50:06.250078 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.260817 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=100 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:06.304126 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124a5e18ffef4643b7f4dcf4e7c2431c', 'request_id': 'req-48a8f50a-bc63-458f-ab6e-91e4a886c879'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.311601 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124a5e18ffef4643b7f4dcf4e7c2431c', 'request_id': 'req-48a8f50a-bc63-458f-ab6e-91e4a886c879'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.325024 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124a5e18ffef4643b7f4dcf4e7c2431c', 'request_id': 'req-48a8f50a-bc63-458f-ab6e-91e4a886c879'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.335865 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] The token cache is being invalidate because project 124a5e18ffef4643b7f4dcf4e7c2431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:06.336155 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.336814 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.338398 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 843/1665] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:06 2022] DELETE /identity/v3/projects/124a5e18ffef4643b7f4dcf4e7c2431c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:06.342354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.343742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.356881 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59c04-c5d7-471b-be50-59a54c32aacc admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.412293 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.413200 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.413486 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.413772 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] PATH_INFO: `/v3/users/729674baac454e5eb85c5c3e9fecaf6b` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.425922 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=729674baac454e5eb85c5c3e9fecaf6b)` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.427832 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.476218 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729674baac454e5eb85c5c3e9fecaf6b'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.480742 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:06.489603 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729674baac454e5eb85c5c3e9fecaf6b'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.490389 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729674baac454e5eb85c5c3e9fecaf6b'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.497187 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729674baac454e5eb85c5c3e9fecaf6b'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.497825 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.notifications [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729674baac454e5eb85c5c3e9fecaf6b'} {{(pid=80384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.510049 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 823/1666] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Jul 11 14:50:06 2022] DELETE /identity/v3/users/729674baac454e5eb85c5c3e9fecaf6b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:50:06.682288 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Authenticating user token {{(pid=80385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:50:06.683803 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.fernet_utils [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:50:06.697276 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8f50a-bc63-458f-ab6e-91e4a886c879 admin admin] Validating token access rules against request {{(pid=80385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:50:06.756615 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab535bfd955b40ebbede39640e8b5ce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75a3ebcd7160438e930735c88021e880', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:50:06.757517 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:50:06.757828 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:50:06.758117 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] PATH_INFO: `/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320` {{(pid=80385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:50:06.769483 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b26ed3e3d34aa8a6078bcae00f5320)` {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:50:06.771382 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] RBAC: Authorization granted {{(pid=80385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:50:06.815931 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b26ed3e3d34aa8a6078bcae00f5320', 'request_id': 'req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.823099 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b26ed3e3d34aa8a6078bcae00f5320', 'request_id': 'req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.829128 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b26ed3e3d34aa8a6078bcae00f5320', 'request_id': 'req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac'} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.839717 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] The token cache is being invalidate because project 49b26ed3e3d34aa8a6078bcae00f5320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:50:06.840008 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.840633 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG keystone.notifications [None req-c5b8dc68-dd7a-45f6-8bc0-e69eb0823aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:50:06.842202 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: [pid: 80385|app: 0|req: 844/1667] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Jul 11 14:50:06 2022] DELETE /identity/v3/projects/49b26ed3e3d34aa8a6078bcae00f5320 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:50:16.506516 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:50:16.836734 dv-osbrick-master-4-iscsi devstack@keystone.service[80385]: DEBUG dbcounter [-] [80385] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:53:20.107328 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Authenticating user token {{(pid=80384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:53:20.108745 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:20.176100 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d428999-9785-4a1a-9a04-b6ba4514f09c admin admin] Validating token access rules against request {{(pid=80384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:53:20.234428 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de41fb2b889b4847bfecbe6ea7585803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77e710ed947f4faaaafaf8b34d1028b6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:53:20.235072 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] REQUEST_METHOD: `GET` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:53:20.235354 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] SCRIPT_NAME: `/identity` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:53:20.235630 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:53:20.237439 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.fernet_utils [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:53:20.248028 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:53:20.249624 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7451f1-5344-479e-9627-cc3ed5dbd75a service placement] RBAC: Authorization granted {{(pid=80384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:53:20.259569 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: [pid: 80384|app: 0|req: 824/1668] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Jul 11 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:53:30.255166 dv-osbrick-master-4-iscsi devstack@keystone.service[80384]: DEBUG dbcounter [-] [80384] Writing DB stats keystone:SELECT=58 {{(pid=80384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}